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Preface 


I was first introduced to matrices as a first-year student of electrical 
engineering at the University of Copenhagen, and I can still vividly 
recall my elation when the power and beauty of this fascinating 
branch of modern algebra dawned upon me. Close and effective 
liaison must have existed between the departments of pure science, 
for the algebra taught us by the professors of pure mathematics was 
immediately employed by their colleagues in the fields of applied 
mathematics, geometry and physics. Consequently, we were made 
to realize at a very early stage that matrix algebra is more than an 
intricate system of abstract symbols. In retrospect I can see, what I 
did not clearly appreciate at the time, that in many instances we 
actually wandered into the realm of tensor analysis. More’s the 
pity that the effective analytical tool with which we had been issued 
was virtually ignored in our subsequent engineering courses. 

If I were to emulate the leaders of the French Revolution by coining 
a slogan such as the famous Liberté: Egalité: Fraternité, in order to 
epitomize the glories of matrices and tensors, I might employ as 
my mots justes the words Organization: Unification: Visualization. 

By means of matrices, discrete elements are combined to form 
higher entities which are manipulated as units and denoted by single 
symbols. One advantage of such an organized analysis is the emer- 
gence of general principles and concepts which were previously 
hidden in a jungle of haphazard ad hoc symbolisms. 

Also, matrices enable many apparently unrelated analytical and 
physical systems to be brought together under one unified point of 
view, thus facilitating co-operation between the various branches of 
pure and applied science. As a result, weapons of analysis and 
synthesis which have proved their worth in one field can more easily 
be switched to other fronts. This is all the more important today, 
seeing that the field of scientific knowledge is expanding so rapidly 
that it is virtually impossible for anyone, however gifted and diligent, 
to keep abreast of current advances. 

But probably the most useful property of matrices and tensors 
lies in the fact that operations and concepts that have been defined 
by purely algebraic means can be visualized in space. For one thing, 
this is of great mnemonic value. I doubt whether anybody could 
possibly remember all the theorems given in this book if they had 
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to be understood simply as algebraic formulae. Having once 
grasped the geometric significance of a theorem, however, the reader 
can picture spatially what is being done and there remains very little 
to remember even in cases where the number of dimensions exceeds 
that of intuitive three-dimensional space. 

Another advantage is the suggestiveness of the geometric approach. 
Having translated a problem into the language of geometry, we are 
often able to visualize certain of its analytical difficulties and limita- 
tions, or to see new methods of attack which would not be at all 
obvious to an investigator employing purely algebraic reasoning. 

And lastly, geometry provides a universal language by means of 
which ideas can be exchanged between scientists who would not 
otherwise understand each other’s technical terminology. 

In 1953 I was asked to give a series of ten out-of-hours lectures 
on matrix algebra and its applications at the University of the 
Witwatersrand in Johannesburg. The very gratifying attendance 
during the whole of the course seemed to point to a strong latent 
desire to know more about the subject. This book has grown out 
of the notes compiled for the course, and they in turn were influenced 
by my early training in Copenhagen. 

In the first place, therefore, thanks are due to my Danish teachers, 
Professors Jakob Nielsen, A. F. Andersen, Richard Petersen and 
Borge Jessen. I have often had occasion to be grateful for their 
thorough and systematic instruction. Secondly, no author describing 
the electrical applications of matrices and tensors could possibly 
ignore the inspiration received from Gabriel Kron of Schenectady, 
U.S.A. Without his pioneering work some of the chapters of this 
book could not have been written. 

Professor A. Heydorn encouraged the work from the very begin- 
ning, Professor C. Jacobsz kindly read the manuscript and offered 
much constructive criticism, Mr. C. H. Badenhorst gave unstintingly 
of his time, and Mr. P. Jumat performed wonders on the duplicating 
machine. I have great pleasure in acknowledging this help. 

And last but not least I should like to express my gratitude to the 
publishers for their unfailing helpfulness and courtesy. 

It has been my aim in writing this book to let the reader share 
my enthusiasm for the beauties of matrix algebra and to help him to 
see the “shape” of the subject. I hope I have succeeded. 

R. BRAAE 

University of Stellenbosch, 

Stellenbosch, 

November, 1961 
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CHAPTER 1 


Introductory 


1.1. Scope of the Book 


Durinc the past decade, matrices have been appearing with in- 
creasing frequency in electrical journals, and many electrical engineers 
are realizing that a knowledge of the elements of matrix algebra 
has become a necessary prerequisite if they wish to keep abreast of 
developments in many branches of electrical engineering. 

This book, written by an electrical engineer for electrical engineers, 
has been compiled to meet this need. It does not profess to be a highly 
mathematical treatise dealing rigorously with the concepts under- 
lying modern algebra and then erecting a rigid structure upon a 
well-prepared foundation; in fact, professional mathematicians will 
consider many of the proofs to be nothing more than loose demon- 
strations. Rather, the aim of the author has been to provide a 
text that will enable an engineer of reasonable mathematical ability 
and with a modest mathematical background to work his way in 
easy and convincing steps from first principles to a standard where 
he will be able to read articles employing matrices without too 
much difficulty. 

In the course of the exposition the concepts ‘ransformation, 
invariance and group are defined, and the theory of matrices is 
developed in such a way as to dovetail with that of tensors. In this 
manner a key is provided to the fascinating world of applied tensor 
analysis pioneered by Gabriel Kron. 

The reader is encouraged to adopt a broad view of the subject. 
Matrix algebra is more than a system of symbols; it provides a 
higher point of view and enables essentially non-spatial concepts 
and relationships to be visualized geometrically. This feature is 
being exploited by various individuals and research teams in an 
endeavour to make geometry the universal language of advanced 
engineering. 

In order to foster a broad approach to our subject we shall not 
confine ourselves to the purely electrical applications of matrices. 
Strictly speaking, an engineer can make use of matrix algebra if 
he knows how to multiply two matrices, understands what is meant 
by rank and can compute the inverse of a non-singular matrix. But 
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on these iron rations he will find himself ill-equipped to do any 
original work. For this reason Chapters 8 and 9 have been included. 
They are not necessary for an understanding of the subsequent 
chapters on network theory, but serve to give the reader a deeper 
insight into the nature of matrices by applying them to some non- 
electrical subjects. 

The book is designed for self-study. It contains many exercises 
to which the serious student can turn his hand in order to gain 
practice in manipulating matrices. It is particularly important that 
he should learn to think of a matrix as a single unit rather than as a 
number of separate elements. 

A number of asides have been added in the form of notes. They 
contain additional details or different points of view which could 
not readily be incorporated in the main body of the text. 

During a first perusal, exercises and notes should be by-passed. 
This will enable the student to get an impression of the scope of the 
book before attempting to master its contents in detail. At the 
second reading every exercise should be treated as a problem and 
all the notes should be carefully studied. Additional problems will 
be found at the end of most chapters. 


1.2 Nomenclature 


A formidable stumbling-block to anyone wishing to acquaint 
himself with matrix and tensor analysis is the hopeless confusion that 
exists as regards nomenclature. Not only is there a multiplicity of 
terms for most concepts, but one and the same word means different 
things to different authors. 

There being no absolute authority on the subject, we shall intro- 
duce out own system of terminology, which will, however, follow the 
lead given by men such as Schouten, Gibbs, Kron and le Corbeiller. 
To make things easier for those readers who might wish to proceed 
to more advanced books on the subject, alternative names are given 
in brackets whenever a new term is introduced. Also, for the sake 
of style, we shall frequently employ two or more words to cover 
the same thing. For instance, a square matrix whose determinant 
is non-zero has an inverse and is said to be either invertible or non- 
singular. These two terms will be used at random. 


1.3. Notation 

Two systems of notation are in common use, direct notation and 
kernel-index notation. 

In direct notation a matrix is denoted by a single symbol set in 
bold type. We shall adopt the convention that 1-matrices (vectors) 
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will be denoted by bold italics, whereas 2-matrices are set in bold 
upright type. Because of the way matrix multiplication is defined 
the order of the factors in a product is important. 

According to the kernel-index system a matrix or tensor is indicated 
by means of a kernel letter together with upper and/or lower indices 
(the number of which is called the valence of the matrix or tensor). 
Multiplication or, as some authors term it, compounding, of two 
quantities is shown by repeating an index (a so-called dummy index) 
and employing Einstein’s summation convention which dispenses 
with the summation sign &. Thus 


n 
ce 
AgyX = 2 aux! 
r= 


D vey 
where = means “equal to by definition.” 

When kernel-index notation is used the method of compounding 
is clearly shown by the position of the indices and the order of the 
factors is therefore of no significance. 

Kernel-index notation is superior to direct notation when quantities 
of valence higher than 2 are considered. Both systems are essentially 
shorthand notations, and when actual calculations are to be per- 
formed the matrices must be written out in full (or punched on cards) 
as arrays of numbers or symbols. 

We shall employ direct notation except in the chapter on tensor 
analysis, where the more versatile kernel-index notation will be 
used. This will allow the reader to master the simpler direct notation 
which will suffice for most purposes and still acquaint him with the 
kernel-index system, which he will have to know if he wishes to go 
on to more advanced texts. 


1.4, Historical Note 


Descartes’s introduction in 1637 of analytical geometry brought 
about a beautiful organization of algebra and geometry. A point 
in space was indicated by three numbers (its coordinates with respect 
to three axes of reference), and a number of well-known algebraic 
identities could now be interpreted geometrically. 

Wessel in 1797 and Argand in 1806 showed how complex numbers 
might be represented by points in a plane and the algebraic operations 
of addition, subtraction, multiplication and division given geometric 
significance. 

In 1843-44 the almost simultaneous appearance of Grassmann’s 
Ausdehnungslehre and Hamilton’s Quaternions ushered in an algebra 
of geometric forms from which sprang among other things the 
discipline of mathematics known as vector analysis. Grassmann’s 


4 INTRODUCTORY 


theory of extensions was conceived on such a wide scale that it 
contained the germs of matrix and tensor analysis. Probably be- 
cause his work was so far ahead of its time, Grassmann never 
received the recognition he so richly deserved. 

Determinants were used by Leibniz (1693) for the solution of 
simultaneous linear equations. This work was forgotten, however, 
and only revived in 1750 by the Swiss mathematician Cramer, who, 
in an appendix to his book, Jntroduction a l’analyse des lignes courbes 
algébriques, gave the basis for the theory of determinants. Jacobi 
also made important contributions to this branch of mathematics, 
and his name is still connected with a particular determinant of 
derivatives (the Jacobian). 

By way of linear substitutions, Cayley was led in 1858 to introduce 
matrices (the name of which was suggested by his friend and fellow- 
mathematician Sylvester). The typical row-by-column composition 
of two matrices developed naturally from the manner in which two 
substitutions are combined. 

Tensor analysis, which embraces most of the ideas and techniques 
of vector and matrix algebra in addition to concepts culled from the 
fields of non-Euclidean geometry and the theory of groups, was first 
expounded by the Italian Ricci in 1888. In 1901 Ricci and a pupil 
of his, Levi-Civita, published a paper on the absolute differential 
calculus and its applications which, however, did not attract much 
attention at the time (the name /ensor is of later origin; it was first 
used when the calculus was applied to the theory of elasticity). 

Einstein’s use of tensors in developing his famous models of the 
universe, special relativity in 1905 and general relativity in 1916, 
gave considerable impetus to their general acceptance, and Heisen- 
berg’s matrix mechanics in 1925 focused attention on the field of 
matrix algebra. 

Tensor analysis was applied to analytical dynamics by Synge 
(1926) in a paper entitled “On the geometry of dynamics.” 

In the field of electrical engineering, Feldtkeller and Strecker 
studied the properties of four-poles by means of matrices (1929). 

In 1932 Kron entered the arena with the mimeographed work 
Tensor Analysis of Rotating Machinery, and since then a steady flow 
of papers and books dealing with the analysis of electromechanical, 
thermal, nuclear and even transportation systems by means of matrix 
and tensor techniques has come from his hand, culminating in 1953 
with the announcement of the principle of diakoptics, i.e. the analysis 
of large and complicated systems by means of tearing. 

During the last ten years two organizations have been formed for 
the purpose of studying and promoting tensor and matrix algebra 
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as a universal language for engineers. One of these organizations is 
the Research Association of Applied Geometry, the foundations of 
which were laid in 1951, when a group of Japanese mathematicians, 
physicists and engineers led by Professor Kondo of the University 
of Tokyo commenced a research programme entitled “The Unifying 
Study of Basic Problems in Engineering and Physical Sciences by 
Means of Geometry.” Since its inception the R.A.A.G. has pub- 
lished two massive volumes containing articles on the application 
of matrices, tensors and topology to a wide variety of engineering 
problems. 

A second organization, the Tensor Club of Great Britain, was 
founded in 1950 to promote “the application of determinants, 
matrices, vectors, dyadics and tensors to the engineering and physical 
sciences.” 

As to the future there can be no doubt that geometry will become 
increasingly important as a common medium of expression by means 
of which research workers in various fields of physics and engineering 
will be able to discuss problems which may differ in detail but which 
are basically isomorphic. 

The electrical engineer who is interested in the more advanced 
theoretical aspects of his subject, but who is ignorant of matrix 
algebra and tensor calculus, may well find himself at a serious 
disadvantage. 


CHAPTER 2 


Scalars and Vectors 


2.1. Algebraic Operations with Scalars 

WueN developing a manipulative system of symbols (or, in other 
words, an algebra) there are certain principles and entities the 
validity and existence of which must be examined before the algebra 
can be applied to any practical problems. They are— 


(i) The commutative principle. 

(ii) The associative principle. 
(iii) The existence of an identity (or unit) element. 
(iv) The existence of the inverse of an element. 


If the algebra permits of more than one operation, the validity of 
the distributive principle must also be investigated. 

In this book we are exclusively concerned with the algebraic 
operations of addition (subtraction) and multiplication (division). 
Also, by number we shall mean either real or complex numbers. 

If we consider addition of numbers, both the commutative and 
associative principles are valid: a+b =b-+ a, and @+b)+c 
=a+(b+ ). Zero is the identity element which when added to 
another element leaves it unchanged: a + 0 = a. For any element 
a there exists a unique additive inverse (opposite) element —a such 
that a + (—a) = 0. 

Multiplication of numbers is also both commutative and associa- 
tive. The identity element is unity, and for each non-zero element a 
there sexist a unique inverse (reciprocal) element a~ such that 
a.q*=1. 

Combining the two operations is the distributive principle. 
Multiplication is distributive with respect to addition; thus 


a(b + c) = (ab) + (ac) 


whereas addition is not distributive with respect to multiplication. 

It may, however, amuse an electrical engineer to recall that in 
Boolean contactor algebra perfect symmetry exists between the two 
operations, so that 


a+ (bc) = (a+ b)a+c) 
6 
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Many of the entities to be introduced later do not comply with all 
the above-mentioned conditions. It is therefore necessary continually 
to bear in mind which operations are permissible and which are not. 


2.2. Algebraic Operations with Vectors 

A collection of m numbers taken in a definite order is called an 
n-dimensional vector. We shall denote vectors either by writing 
them out in full as a column of numbers or letters held together by 
brackets or as one letter set in bold italics. Thus 


The a’s are the coordinates (components) of the vector and n is 
its dimension. A vector is also termed a 1-matrix (monovalent 
matrix). In kernel-index notation it is written a; or a‘, where i is a 
running (free) index with the range | to n. 

Two vectors of equal dimension are added by adding correspond- 
ing coordinates— 

a by a + by 
A+B=} \4}) bad’ 
a, by a, + b,, 

An important vector is the nullvector, all the components of which 
are zero; it is denoted by 0. 


1 0} 0 
0 1 0 
Kal) ello, Us 
0 0 0 
0 0} 1 


are the 7 n-dimensional unit vectors. 
A vector is multiplied by a scalar by multiplying each coordinate— 


a ka, 

ay kay 
kA=k =J. 

a, ka, 
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When defined addition of vectors is commutative and associative, 
0 is the zero element and —A is the additive inverse of A. Multiplica- 
tion of a vector by a scalar is distributive. Multiplication of one 
vector by another will be defined later (see Sections 5.1 and 5.2, 


p. 51). 


2.3. Linear Combination of Vectors 


When a number of equi-dimensional vectors are multiplied by 
arbitrary constants and added, the sum is said to be a linear com- 
bination of the vectors— 


B= kA, + kyla t+... +kmAm 


If all the constants are non-negative we speak of a positive linear 
combination. 


Exercise 1. Compute the linear combinations A — B and A + B— 2C, 
where 
-1 


3 1 
A=49, B=} 7), C= 5 
2 0 1 
Exercise 2. Calculate the linear combination 
B=kU, + kU, +...+kaUy 


where U,, U,,. . ., U, are the n n-dimensional unit vectors. 


2.4. Linear Independence of Vectors 


A set of vectors Aj, Ay,. . ., A,, is said to be linearly independent 
if the vector equation 


XyAy + XpAg +... + Xm An = 0 


is satisfied when and only when all the coefficients x are zero. 
Otherwise the vectors are linearly dependent. 

The three 4-dimensional vectors in Exercise 1, Section 2.3, are 
linearly dependent since a linear combination of them with non-zero 
coefficients is equal to the 4-dimensional nullvector. 


Exercise 1. It is vitally important that the reader should grasp the signifi- 
cance of the concept of linear independence as soon as possible. At first the idea 
will mean no more than the literal content of its definition; but gradually he 
will develop a feel for the concept and be able to visualize in space what he is 
doing algebraically. 

In the case of 3-dimensional vectors in ordinary Euclidean 3-space the condi- 
tions for linear independence are set out in Table 2.1. 
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Table 2.1 


CONDITIONS FOR LINEAR INDEPENDENCE OF 
3-DIMENSIONAL VECTORS 


Number ie ; All linear 
of pace pee combinations 
vectors will lie in 
1 vector must be 1- 
non-zero {a line) 
2 vectors must be 2-space 
non-collinear (a plane) 
3 vectors must be 3-space 
non-coplanar (“‘space’’) 
4or 4 or more 3-dimensional 3-space 
more vectors are always 
linearly dependent 
aE | ie PE ee ee es 


Exercise 2. The n n-dimensional unit vectors are linearly independent, since 


1 
Xs 
XU, + QU, +... +x,U, = 


Xn 
and this vector can only equal the n-dimensional nullvector when 
MHXy=H... =x, =0 


Exercise 3. It is readily proved that a set of vectors containing the nullvector 
is linearly dependent. Let the set consist of the vectors O, Aj, Ag,. . .,Am- 
The equation 

xO +0A,+0A,+...+0A,, =0 


is satisfied for any value of x. The set is therefore dependent. 


Exercise 4. Let a set of linearly independent vectors Aj, . . ., Ay, be given. 
We shall now prove that any subset of this set will also be linearly independent. 
If we assume the subset to be linearly dependent, we have 


kA, + kaAa, ++ «+ kya, = 0 


where p < m3 4}, @g,. . .; @» is a subset of the numbers 1 to m; and the k’s are 
not all zero. 

Such an assumption would, however, lead to the conclusion that the set of 
A-vectors were linearly dependent, since the equation 


kyAq + keAg, +... + kpAa, +0Ag,,, ++.» + 0A, =O 


would also be satisfied, and this is contrary to our hypothesis. Hence, the subset 
is linearly independent. 


10 SCALARS AND VECTORS 


Theorem 1. Ina set of linearly dependent vectors at least one vec- 
tor of the set can be expressed as a linear combination of the others. 

Proof. Let Ay, Ag,. ..., Am, be a set of linearly dependent vectors. 
Because the vectors are dependent there must exist a set of numbers 
Xy, + + +; Xp, not all of which are zero, such that 


xyAy + XeAg +... + %nAn = 0 
Assume for the sake of convenience that x; #0; then 
Ay = — (%2/%,)Ay — (s/XAs - - - — Onl Am 


which proves the theorem. 
Conversely, if one vector in a set can be written as a linear com- 
bination of the others, the set is linearly dependent. 


Exercise 5. A set of n-dimensional vectors 


a, by Cy 
ie @&-2 |” B bn_2|” Cha 
An ‘nL 
an, 0 
where @,, bn1, Cn-2,- - - ate non-zero, is linearly independent. 


The linear combination 
xXyA+mMB+xC+... 


can only equal the nullvector if its mth coordinate x,@, vanishes. This requires 
x, = 0. To make the (m — 1)th coordinate vanish, x, must be zero, and by 
continuing this train of reasoning we conclude that all the coefficients must be 
zero, which means that the vectors are independent. The proof hinges on the 
fact that the number of vectors in the set must be < n. 


Let A,, Ao,. . ., A; be a set of vectors. From this set we derive another set 
as follows— 
B, = A,, B, = A, + kAy,. « «Bm =Am + kmAy 
where ko, kg, . . ., Km are arbitrary constants. 


We shall now prove that, if the A-vectors are linearly independent, then so are 
the B-vectors, and vice versa. 

Consider a linear combination of the B-vectors— 

2B, + x2By +... + XmBm = x74, + Ap +.» + XmAm 
where xj = x; + Kox, +. - - + KmXm- 

If we assume the A-vectors to be linearly independent, the linear combination 
given above will only equal 0 if xj = x2 =. . . = Xm = 0; hence x, = 0 and 
the assumption that the B-vectors are dependent will immediately lead to a 
contradiction. 

Conversely, if we let the B-vectors be independent, we can conclude that the 
A-vectors, too, are independent. 


We are now in a position to prove an important theorem. 
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Theorem 2. A set of mn-dimensional vectors is linearly dependent 
when m > n. 

Proof. Let A;, . . ., A, be m n-dimensional vectors and let the 
nth coordinate of A, be non-zero. 

It is now possible, as demonstrated above, to derive a set of 
vectors, B,, . . ., B,,, which are linearly independent when the set 
of A-vectors are independent, and dependent when the A’s are 
dependent. 

By choosing suitable values for the k’s we can make the nth 
coordinate of the vectors B,,..., B,, vanish. If, during this 
process, one of the B-vectors is reduced to the nullvector, our proof 
is complete. Otherwise, we can repeat the operation with a B-vector 
the (m — 1)th coordinate of which is non-zero and obtain m — 2 
vectors C;, . . ., €,, the nth and (m — 1)th coordinates of which 
are zero. 

It is clear that by continuing this process it is always possible to 
reduce the set of A-vectors to a set containing no more than 7 vectors 
of the type discussed in Exercise 5, and the remaining ones to 
nullvectors. When m > n the derived set will thus contain at least 
m — n nullvectors and therefore be linearly dependent. Hence, the 
original set is dependent. This proves the theorem. 


Exercise 6. The four 3-dimensional vectors 


th Gh eh 


are reduced in the manner just described to 


Fe lc 


In order to visualize the algebraic operations of this exercise the vectors 
should be plotted in a perspective sketch. 

Note. The act of multiplying a vector by a constant and adding it to another 
vector is termed a linear operation. We can thus look upon the set of B-vectors 
as being derived from the 4-set by means of linear operations. It was proved that 
two sets of vectors related in this way are either both linearly independent or 
both linearly dependent. 

Paraphrasing this result we can say that the linear independence of a set of 
vectors cannot be destroyed, or in fact altered in any way, by linear operations. 


2.5. Linear Vector Manifold—Rank 


The maximum number of linearly independent vectors that can 
be selected from a finite or infinite set of n-dimensional vectors is 
called the rank of the set. Such a linearly independent subset is 
said to form a base of the set. As we see from Theorem 2, the rank 
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of a set of vectors can never exceed the dimension of the vectors 
of the set. 

Suppose V;, V,, . . -, V, to be a base of the set. Then the vectors 
V,,..., V,, A, where A is any vector of the set, must be linearly 
dependent, and A can therefore be written as a linear combination 
of the base vectors— 


A=aV,+...+4,V, 


The a’s are the coordinates of A in the frame of reference formed 
by the base vectors. 

The resolution of A into components along the axes of the base 
is unique. To prove this let us assume that A could be resolved in 
another way as 

A=5V,+6,.¥,+...+6,¥, 


Since A — A = 0, we get 
(a, — b)V, + (@ — b)Vg+..-+(@—45)V,=0 


and because the V’s are linearly independent, the coefficients of the 
V’s must all vanish and we have a, = b,, a, = by, . . ., 4, = b,, 
which proves the uniqueness of the resolution. 

An infinite set of vectors of rank p is called a linear vector manifold 
(a centred vector space, an E,, a p-direction) if it meets the following 
conditions— 

(i) If it contains the vector A it will also contain the vector kA, 
where & is any real number. 

(ii) If it contains the vectors A and B it will also contain the 
vector A + B. 

In short, if the set contains certain vectors, it will contain all linear 
combinations of them. 

The rank r of a vector space is the maximum number of linearly 
independent vectors that can be selected from it. Such a set forms 
a base of the manifold, and any vector belonging to the manifold 
can be uniquely expressed as a linear combination of the base 
vectors. The manifold is said to be spanned (generated) by the base 
vectors. 

Table 2.1 shows a number of manifolds in 3-dimensional space. 


2.6. Linear Equations 

By employing the concepts just introduced it becomes possible 
to treat systems of simultaneous linear equations in an organized 
and systematic manner. 
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A set of n linear equations with m unknowns is usually written 


Oy Xy + AygXq +--+ AymXm = by 
FayXy + AggXq +. - - + domXm = dg 


ny Xy + AggXo +. » «+ AnmXm = by 


The problem to be solved can be stated: Does a set of m numbers 
X4,- + +;Xm exist such that the above n equations will be simul- 
taneously satisfied ? 

In vector notation the equations can be written much more con- 
cisely as 

XA, + %Ag t+... + XpAm = B 


and the problem can be reworded: Can the vector B be expressed 
as a linear combination of the vectors Aj, Ag, . . ., Am? 

Apparently the necessary and sufficient condition for a solution 
is that B shall belong to the vector space spanned by the A-vectors. 
The great advantage of this approach lies in the fact that the problem 
can be visualized geometrically. Even when » > 3 and we can no 
longer rely on our normal spatial intuition, geometry is still a very 
helpful guide. 

A general discussion of simultaneous linear equations is given 
in Sections 4.1 and 4.2, pp. 33 and 35. 


PROBLEMS 


2.1. Prove that the three 4-dimensional unit vectors U,, U, and U; are linearly 
independent. 
2.2. According to Theorem 2, the three 2-dimensional vectors 


She om eats 
a= {i} 9 {3} mt =f 
must be linearly dependent. Express each vector as a linear combination of the 


others and plot the results in a plane coordinate system (not necessarily an 
orthogonal system). 


anf} af a aL] 


be 3 vectors in a three-dimensional Cartesian coordinate system. Are these 
vectors independent? Form a new set of vectors B, = A,, B, = A, + kpAj, 
B, = A, + k;A,. Sketch both sets and discuss the fact that both sets are either 
linearly independent or linearly dependent. 
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2.4. Repeat Problem 2.3 with the following three vectors— 


A= Be ie i: Ae | i 


2.5. Let four 4-dimensional vectors 


—2 4 2 2 
A=} Ut, A=47), A= ms and A,= re 
2 1 -1 xj 
be given. 


Determine x such that the four vectors are linearly dependent. Interpret the 
result geometrically. 


CHAPTER 3 
2-Matrices and Determinants 


3.1. 2-Matrices and Their Rank 


AN array of elements consisting of n rows and m columns is called 
an n-by-m matrix (2-matrix, matrix of valence 2, divalent matrix) 
and denoted by a, (i= 1, . . ., m; j= 1, . . ., m) in kernel-index 
notation, or simply by A in direct notation. 

Another way of looking at a matrix is to consider it as an aggregate 
of m n-dimensional column vectors or n m-dimensional row vectors. 
These two sets of vectors are naturally closely related, consisting 
as they do of the warp and woof of one and the same array of numbers. 
This interrelation is given in the next theorem. 


Theorem 3. The set of vectors formed by the columns and rows 
of a matrix are of equal rank. This rank is that of the matrix. 

Let the rank of the column vectors be s. Hence s of these vectors 
will span the set, and by interchanging columns we can move these 
s vectors so that they occupy the first s columns. This process will 
permute a number of the coordinates of the row vectors but will 
in no way affect the rank of the set. Likewise, the r vectors forming 
a base for the set of row vectors are moved so as to occupy the first 
r rows. Our problem is now to prove that s = r. 

We know that the s column vectors are linearly independent, and 
we shall now prove that, if their dimension is reduced by deleting 
their last m — r coordinates, they will still be linearly independent. 

If we assume that the reduced vectors are linearly dependent, then 
the equation 


Coty Ae a, 0 
yy App ay, 0 

kyy+ pkey: be. Hh pp =H4° . 3.1) 
any Fre ays 0 


will be satisfied by a non-zero set of k’s. 

Since the first r row vectors span the complete set, all those in 
rectangle b of the matrix shown diagrammatically in Fig. 3.1 are 
linear combinations of the row vectors in a. 

15 
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As a result the k’s of eqn. (3.1) will also satisfy the equation 


Fa | 441 2 Gia s 0 
G42 1 G12 2 F428 0 

ky: + ke+- +...+h,4- =y>p (3.2) 
a, 4 G& 2 ans. 0) 


This in turn means that the s column vectors are linearly depen- 
dent, which is contrary to our premiss. Thus the s r-dimensional 
column vectors are linearly independent, and according to Theorem 2, 


Beers 
He 


Fic. 3.1. THE RANK OF A MATRIX 


p. ll, sar. By repeating our arguments in terms of the r s- 
dimensional row vectors we conclude that r= s. Hence r = s, which 
proves the theorem. 

This common rank r (= 5) is that of the matrix. As we have seen, 
it is invariant to any interchange of rows or columns. 


Theorem 4. If the elements in a column (row) of a matrix are 
augmented by those of another column (row) multiplied by a con- 
stant, the rank of the matrix remains unaltered. 

After the operation the column (row) vectors will be linear com- 
binations of the columns (rows) of the original matrix and will 
therefore belong to the same vector space. As we have shown in 
Section 2.4, p. 10, the new set of vectors will have the same rank 
as the old set. The rank of the matrix is thus the same as before. 


3.2. Permutation of the Positive Integers 

Before turning our attention to the theory of determinants there 
are a few concepts in connexion with the permutation of positive 
whole numbers which must be introduced. 

It is well known that n! permutations can be formed from the 
positive integers 1,2, . . ., m. Let py, Pa, - + +» Pr + + > Po ++ + Pn 
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be one of these permutations. The pair of numbers p, and p, is 
said to be an inversion if p, > p,, i.e. if the two numbers are not 
written in their natural order. The number of inversions in a given 
permutation is denoted by J(p,, ps, - + -» Pn), and the permutation 
is called odd or even according to whether J(p;, Po, . - -» Pn) is an 
odd or even number. Thus all permutations fall into two distinct 
classes. 


Exercise. The first three integers can be permuted in 3! = 6 ways, and the 
corresponding inversion numbers are given in Table 3.1. 


Table 3.1 
PERMUTATION OF INTEGERS 1, 2, and 3 


Inversion 
Number J 


Permutation Class 


Of these 6 permutations 3 are odd and 3 even. 


If p, and p,., are two adjacent numbers in a permutation, then 
I(p;, - - -; Pp) Will increase or decrease by one when p, and p,,, are 
interchanged. This is readily seen, since the inversions formed by 
p, and p,,; With the rest of the numbers in the permutation will not 
be affected by the change. Therefore, when two adjacent numbers 
in a permutation are interchanged, the permutation changes class. 

Let us now consider what the effect will beif two arbitrary numbers, 
p, and p,..,, are interchanged. We shall achieve our object in two 
steps. First p, changes place with p,, then with p,,. and so on, until 
after s moves it occupies the position formerly taken up by p,..,. 
Secondly, p,., is moved back to p,’s original position; this requires 
s —1 moves. The two numbers have therefore changed place by 
the interchange of adjacent numbers 2s — 1 times. Whatever the 
value of s, this number is odd. So we find that, when two arbitrary 
numbers in a permutation are interchanged, the permutation changes 
class. 

From this result we can infer that the number of odd and even 
permutations of the numbers 1, 2,. . ., m must be the same. If the 
numbers | and 2 (say) are interchanged in each and every permuta- 
tion, we arrive at exactly the same permutations as before simply 
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taken in a new order, and in doing so every permutation has changed 
class. 7 

Consider n doublets (1, p;), (2, ps), - - -; (”, P,), Where the first 
digit indicates the number of the doublet, and p,, . . ., p, is some 
permutation of the integers 1 to n. By interchanging these doublets 
two at a time it is possible to arrange them according to the second 


digit as follows— 
(Gy VD), Ga 2) ~ ++ Gns 2)- 


Thus a certain number of moves has changed p,,. . ., p, intol,. . ., 
n, and simultaneously 1, . . ., 7 into q,. - .; J». From this fact it 
is easily concluded that the permutations p and q must belong to the 
same class. 


3.3. Determinants 


Any square matrix has associated with it a scalar quantity called 
the determinant of the matrix. It is denoted by det (A) or |A|. The 
determinant of an -by-n matrix is said to be of the mth order. 

We now define det (A) to be the sum of the 7! products of n factors 
chosen in such a way that each term comprises one element from each 
row and one from each column. The sign of a term is defined to be 
— 1 to the power [(p,,. . ., p,), Where p;,. . ., Py, are the column 
indices after the factors have been ordered according to the row 
indices. Thus 


det (A) 2 D(—1)Ms+ +0) ayy... + np, + (3.3) 


To most readers this definition will probably seem highly artificial 
and arbitrary at first sight. As the theory of matrices is developed, 
however, the usefulness of determinants will become clear. 


Exercise. A 1-by-1 matrix A = {a} has a determinant det (A) = a. A 2-by-2 
matrix contains 2? = 4 elements— 


4 Me 
Ac 1% M9. 
and its determinant comprises 2! = 2 terms when expanded— 
a 4 
det (A) = tan ies = Gy149q — Aya) 


The second term in the expansion is negative because the permutation of the 
column indices is odd. 

A 3-by-3 matrix contains 3*=9 elements. Its determinant expands into 
3! = 6 terms— 
a 2 Us 
Gz, Aon Me 
43, A32 O33 


A y94g1Agq — Ay 34223, — 42421433 — 411423439 


det (A) = = GyAa9Ay3 + Ay9Ao3051 
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This particular expansion is easily memorized by the following method. The 
first and second columns are repeated after the third column as indicated below, 
and the products along the full (dotted) lines are taken with positive (negative) 


sign. 
ay ae 3 ay 2 
J gr tight: 
7 
7 A bs 
va ¢ 7 
ayy a Gz 
7 ae vA 
7 / 
a3, Qs G33 3, sg 


It must be borne in mind that this method is not valid for determinants of 
higher order. 


Theorem 5. A square matrix and its transpose (the matrix formed 
by interchanging rows and columns) have identical determinants. 

By means of the definition we can expand the determinant of the 
transpose A, of matrix as follows— 


det (Aj) = X(— 1) ayrayo. Aan » (3.4) 


It is readily seen that the terms on the right-hand side of eqn. 
(3.4) are the same as those of eqn. (3.3), except that the latter 
are ordered according to the last index. Furthermore, since the 
permutations p,, .. ., p, and qj, . . ., q,, belong to the same class, 
the two expansions are identical. 


Theorem 6. When all the elements in a row (column) of a deter- 

a are multiplied by a constant k, the determinant is multiplied 
y k. 

This follows from the fact that each term in the expansion contains 
one factor from each row (and one from each column), so that k 
can be factorized. A corollary to this theorem is that any deter- 
minant, a row (column) of which is zero, also is zero. 


Theorem 7. When two rows (columns) of a determinant are 
interchanged the determinant changes sign. 

The numerical values of the terms in the expanded form of the 
determinant are not affected by the change, and since the permutation 
P1s Pas + + +» Py Changes class when two numbers are interchanged, 
it is apparent that each term in the expansion will change its sign. 


Theorem 8. It follows directly from Theorem 7 that a determinant 
in which two columns (rows) are equal (or even proportional) is 
equal to zero. 
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3.4. Cofactors 


In the expanded form of a determinant det (A), (n — 1)! of a total 
of n! terms will contain the element a,,. The sum of these terms can 
be written a,,A,,, Where A,, is called the cofactor of the element a,,. 
Since each term contains only one element from each row and one 
from each column, A,, is independent of the elements in row r and 
column s. 

Hence the expanded form of a determinant can be condensed 
as follows— 


det (A) = a4 + Gp24y9 + + - - + OpnArn - 3.5) 


If we substitute in A the elements in row r by those from another 
row (say p), we know from Theorem 8 that the determinant of this 
new matrix vanishes. Thus we immediately get the important 
identity 
Ay Ary + AypAya +.» + Agn Ary = ei sees ; ms 
Expressed in words we have— 


Theorem 9. The sum of the elements of a row (column) of a 
determinant each multiplied by its cofactor is equal to the deter- 
minant (this is called expanding the determinant about the elements 
of a row (column)). The sum of the elements of a row (column) of 
a determinant each multiplied by the cofactor of the corresponding 
element of another row (column) is equal to zero. 


Exercise. The determinant 


2 3 4[=2.7.84+3.9.54+4.6.10—4.7.5—2.9.10—3.6.8 
eee) = 23 
5 10 8 


The cofactor of element a,; = 2 is 4), =7.8 —9. 10 = —34. The other 
cofactors are easily computed— 


a ee om —34 -3 25 

Ay Ag: Ags p = 16 —4 -—5 

Ag Ae oes -1 6 —4 
and the accuracy of Theorem 9 is easily tested. 


With the help of this theorem we are now able to establish a property of 
determinants which is very useful when calculating the value of a determinant. 


Theorem 10, If the elements in a row (column) of a determinant 
are augmented by the corresponding elements of another row 
(column) multiplied by a constant, the value of the determinant 
remains unaltered. 
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Suppose we multiply the rth row by k and add it to row p. The 
modified determinant det (A’) expands as follows about row p— 


det (A’) = (@,, + kaj)4yi + + - » + Gon + KOn)Aon 
= @yAn eh yA pn) 7 Kg Ap Onc © rpA yn) 
=det(A)+k.0=det(A) (QED) 


3.5. Minors—Subdeterminants 

From an nth order determinant we can form n® determinants of 
order n — 1 by deleting one row and one column. These deter- 
minants are called minors. There is a close relationship between 
the minor M,, derived by deleting row r and column s and the 
cofactor A,.. 


Theorem 11. The cofactor A,, of an element q,, is equal to (—1)’t* 
times the minor M,,. 

A proof of this theorem is best given in two steps— 

(i) First we shall prove that the theorem holds when r = s = n. 

To determine A,,,, we write down all the terms in the expansion 
for det (A) containing the factor a,,,. They are 


D(H + Pw) ayy... nap, nn 


where pj. - - -; Pp; can be permuted in (” — 1)! ways. 
From the above expression it is readily seen that 


Ann = S(—1)l@o+ Pat). ayy,» On—ap, , = Mon 


Thus in this special case the theorem is valid. 

(ii) To prove its general validity we move the element a,, to the 
position occupied by a,,,. First row r is moved by n—r interchanges 
to the position of row m, and then column s is moved by another 
n-s steps to the position formerly taken up by column. The desired 
change has thus been brought about by 2n — (r + 5) interchanges. 
Each time two rows or columns change place the determinant changes 
sign, and the new determinant is therefore equal to the original one 
times a factor (—1)2"- +8 = (—1)"**. 

An identical relation holds between A,, (the cofactor of a,, in the 
determinant det (A)) and 4/, (the cofactor of a,, in det (A’))— 


Ary = (—1)"**Ars 


By inspection it is seen that M,, = M;,, and since we have shown 
under (i) that A;, = M;,, it follows that 


A,, =(—1)**.M,,  (QE.D.) 


2—(T.1046) 
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By means of a chequerboard array of signs (Table 3.2) the value 
of the factor (—1)’** is easily visualized. 


Table 3.2 
CHEQUERBOARD ARRAY OF SIGNS 


ET GY seek RD 8 UoeAS 
bh ee =, oe 
Zul) stun besten Seo eit 
i eS 
2 a ae 2 


3.6. Determination of Rank 


In Section 3.1, p. 15, we introduced the idea of the rank of a 
matrix. The following two theorems will demonstrate how the 
determinants associated with a matrix enable its rank to be 
calculated. 


Theorem 12. An n-by-n matrix is of rank n when and only when 
its determinant is non-zero. 

If the » columns of an n-by-n matrix A are linearly dependent, 
it is possible by means of linear column operations such as those 
described in connexion with the proof of Theorem 2, p. II, to 
transform A into a matrix A’ in which at least one column is a 
nullvector. Therefore det (A’) = 0, and since det (A’) = det (A) we 
have det (A) = 0. 

It now remains to show that when the rank of A is 7 (in future we 
shall write r(A) = m) then det (A) 4 0. 

When r(A) = the column vectors of the matrix are linearly 
independent. Let 


ay aye . - Ay, 
det (A) =| 7% 422 > + Mn 
Gnu 4g + + Ann 


and suppose that a,, 40. We now multiply column | by suitable 
constants and add it to the other n — 1 columns so as to make their 
first coordinate vanish. This operation does not alter the rank of 
the matrix (Theorem 4) nor does it alter the value of det (A) 
(Theorem 10). 
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The transformed determinant is 


a, 0 Pla td 
det ( A’) on Ag, Age + + Gay 
Ga Qe st dae 


the m column vectors of which are linearly independent. The n — 1 
last columns of det (A’) form a subset which is also linearly indepen- 
dent (see Exercise 4, Section 2.4). Thus the (7 — 1)-by-(n — 1) 
matrix 

Gs. Ay 


B J . . 
Ge. «Ann 
will be of rank n — 1. By expanding det (A’) about its first row and 
noting that det (B) = Aj, (the cofactor of a,;), we see that 


det (A) = det (A’) = ay, . det (B) 


If we therefore assume that det (B) 40 then det (A), too, is non- 
zero. Since a 1-by-1 matrix is of rank 1 when its determinant is 
non-zero, the theorem must by induction hold in all cases. 


Theorem 13. An n-by-m matrix is of rank r if it contains at least 
one non-zero subdeterminant of the rth order but no non-zero 
subdeterminant of higher order. 

By linear operations which do not affect rank, the matrix can be 
transformed into another with r linearly independent columns 
occupying the first r columns, r independent rows occupying the 
first r rows, and all the other elements equal to zero. From this 
second matrix the theorem is immediately apparent by inspection. 


3.7. Algebraic Operations with Matrices 

In this section we shall develop an algebra of matrices by defining 
the operations of addition and multiplication. Before doing so, 
however, we must introduce some new terms. 

Two matrices with the same number of rows and columns are 
said to be like. A nullmatrix is one in which all the elements are 
zero. Nullmatrices are denoted by 0, and it is left to the reader to 
conclude from the context the particular shape of the nullmatrix 
in question. 

Like matrices are added by adding corresponding elements. This 
process is commutative and associative. A zero element (0) and 
the opposite of a matrix exist. 
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A matrix is multiplied by a constant k by multipying each of its 
elements by k. This operation is commutative and associative. Also, 
If A is an n-by-n matrix, 


det(kA)=k"det(A)  . .  . (3.6) 


A square matrix in which the elements along the main diagonal 
(top left to bottom right) are unity, and the remainder are zero, is 
called a unit matrix (identity matrix, idemfactor, Kronecker delta). 
Tt is written 
F010) 310 
re Oe se 

1 
also det (I) = 1. 

A square matrix which has non-zero elements along only the main 
diagonal is called a diagonal matrix. Its determinant is equal to the 
product of the diagonal elements. 

By interchanging the rows and columns of a matrix A we derive 
its transpose, which is written A,. When A, = A, the matrix is said 
to be symmetric (self-conjugate), and when A, = —A it is called skew 
(skew symmetric, anti-selfconjugate, alternating). Symmetric and 
skew matrices are necessarily square and the latter have zero 
elements along the main diagonal. 

Multiplication of one matrix by another (also termed the compound- 
ing of two matrices) can be defined in a number of different ways. 
We shall proceed as follows. 

Two matrices can be multiplied when the number of columns in 
the pre-factor is equal to the number of rows in the post-factor. 
The element in the rth row and sth column of the product is equal 
to the sum of the elements in the rth row of the pre-factor each 
multiplied by the corresponding element in the sth column of the 
post-factor. Expressed algebraically, if C = AB, then 


Cry = AppDyy + Aygdoy +.» - + Apnbng = Gridis 


It can easily be seen that the product matrix will have the same 
number of rows as the pre-factor, and the same number of columns 
as the post-factor. 

Matrix multiplication is generally non-commutative (hence the 
necessity for the terms pre- and post-factor), even in cases where 
both AB and BA are meaningful. During the early 1840s, while 
developing his algebra of quaternions, Hamilton was disturbed to 
find that he would have to abandon the commutative principle. 
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It took him a long time to realize that a non-commutative algebra 
could still be self-consistent. 


Exercise 1. 
12 ay 
we Ae ei gil 
ROO) fetal Bug 
Thea AB = {j tf pe PE 
Lain 3 -1 0 
and pa = { : ite i}= : 45 +AB 


Exercise 2. Compute IA and AI, where 


se a 4 

A=,-1 01 

Ye ee 5 

100 io Nay 5 112 

TA=40 1 0-4-1 0 1}=4-1 0 1}=A 

001 21 2 212 
11 2] for" 1 ie? 
and AI=;—-1 0 1-40 1 0}=4-1 0 
ZA 2]. (06 1 21 


This exercise illustrates two points: first that the idemfactor actually is a 
unit matrix, and secondly that matrix multiplication may be commutative in 
special cases. 


Exercise 3. Compute AB and BA, where 
A= {3 i} and B= Be =} 
wo hhh Gigies 
108. jo Bom {2 “Ph 3 {8 “Bh 
This exercise demonstrates that we cannot infer from AB = 0 and A#0 


that B= 0. 


Exercise 4. Prove that two like diagonal matrices commute. 

Let F and G be two n-by-n diagonal matrices with non-zero elements fj, and 
u Tespectively. . 

The element in row r and column s of the product matrix FG is zero when 
r # s, and equal to /,,2;, (no summation) when r = s. The same applies to the 
elements of GF, and therefore FG = GF. 

We have seen that matrix multiplication is generally non-commuta- 
tive. Matrix products are, however, always associative. 


Suppose we have 
(AnnBn)Cog = Ding 
and Ann(BnyCpa) Dina 
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where the subscripts indicate the number of rows and columns 
(respectively) of the matrices. 

In order to prove that D = D’ we shall compute the general 
term of the two matrices. 

The rth row of AB contains the elements 


Apdiq,  ApiDin, « - +» ApDin 

Hence d,, = 4,:b;3C;5 
where we employ Einstein’s summation convention, and the free 
indices i and j run from | to m and from | to p respectively. 

When calculating d’,, we first compute the elements in the sth 
column of BC; they are 

DrsCjor Dashes + «2 Onitis 

and from this we get d;, by multiplication by the elements in row 


rof A. Hence 
drs = pid i304 = dy, 


which proves the associativity of the matrix product. It is thus 
possible to write D = ABC without fear of ambiguity. 
The distributive principle holds good for matrix multiplication— 


A(B + C) = AB+ AC 
and (D + E)F = DF + EF 
It should be carefully noted, however, that the order of the factors 
must not be disturbed. 


A useful theorem which is very easy to derive (the proof is left 
to the reader) is given below. 


Theorem 14. The transpose of a matrix product is equal to the 

product of the transposed factors taken in reverse order. Thus 
(AB), = B,A, 

The conditions under which the inverse of a matrix exists will be 
fully discussed in Section 3.9. 
3.8. Multiplication of Determinants 

Let A and B be two n-by-n matrices. Their product AB will also 
be an n-by-n matrix. We shall now prove the following theorem. 


Theorem 15. The determinant of the product of two square 
matrices is equal to the product of the determinants of the factors. 
Thus 

det (AB) = det (A) det (B) 
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If two rows in A are interchanged the corresponding rows in AB 
are similarly transposed. Also, if a row in A is multipled by a con- 
stant and added to another row, exactly the same operation will 
be performed with the corresponding rows in AB. These linear 
operations leave both det (A) and det (AB) unchanged. 

We subdivide the proof into two cases— 

(i) det (A) = 0. In this case the n rows of A are linearly dependent 
and at least one of them is a linear combination of the others. 
By linear operations we can reduce this row vector to 0, and since 
corresponding row in AB will also consist of zeros, det (AB) = 0 
and the theorem has been proved under these particular conditions. 

(ii) det (A) #0. The rows of A are now independent, and by 
linear row-operations alone we can reduce A to diagonal form. 
This process affects neither det (A) nor det (AB). 

Denoting the diagonalized matrix by A’, we have 


a 0 2 (210 
0 arg 
A’= 
0 0 ap tee 
and 
By Be er 8 
Gy Bg ct 
B=;. 3 
bay bpp s+ Onn 
so that 
@i1by, aby. . Oty 
Grebe, Azabgg «. gabon 
det (A’B) =| . ; 0G OFS 
ee 


In this determinant the aj,’s can be factorized (Theorem 6, p. 19) 
and this leads to 
det (A’B) = det (AB) = ay, . aso. . . a, . det (B) 
= det (A) det (B) 


which proves the theorem. 


Exercise. Let A and B be two n-by-n matrices and let det (B) 4 0. Prove that 
A and AB are of equal rank. 

We loose nothing in the way of generality by assuming A to be a diagonal 
matrix in which r(< m) of the diagonal elements are non-zero. The row vectors 
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of AB will consist of r of the row vectors of B (which are linearly independent) 
multiplied by the non-zero diagonal elements of A. This set of vectors is of rank 
rand the rank of AB is also r. 

3.9. The Inverse Matrix 


In scalar algebra the reciprocal (inverse) of a number was intro- 
duced by posing the question, does a number x exist such that 
x.a=1? The answer was that x existed provided that a 40. 
In matrix algebra the problem is complicated by the much greater 
variety of “numbers” and by the fact that matrix multiplication is 
non-commutative. 

We shall begin, therefore, by seeking the right inverse of a square 
matrix A, i.e. the matrix X which satisfies the equation 


AX =I : : ; - 3.7) 
By Theorem 15 we conclude that 
det (A) . det (X) = det () = 1 
or det (X) = 1/det (A) 
so that X only exists if det (A) #0. In Section 3.4, p. 20, it was 
proved that 
Oy Ay + AypAyg He» » + AynArn = { 


and this means that the matrix 


det(A) when p=r 


0 when pr 


Ay An An 
Ay Aye. a 

X = I/det(A).4 . Mee as : - (3.8) 
Ain Am + + Ann 


will satisfy eqn. (3.7). 
The matrix given in eqn. (3.8) will also be a /eft inverse of A. 
Pre-multiplication of eqn. (3.7) by X yields 
X(AX) = (XA)X = X 


which clearly shows that XA = I. 
We can now formulate another theorem. 


Theorem 16. When the determinant of a square matrix A is 
non-zero the equations AX = I and XA = I have a unique solution 
which is called the inverse (reciprocal) of A and is written A“. The 
elements of A“ are given by eqn. (3.8). Furthermore, det (A“}) = 
I/det (A). 


3.9. THE INVERSE MATRIX 29 


An identity analogous to that of Theorem 14 is given in the next 
theorem. 


Theorem 17. The inverse of the product of two like square 
matrices is equal to the product of their inverses taken in reverse 
order. Thus 

(AB) = B-1A4 


Proof. At this stage we have gained sufficient mastery of the 
technique of matrix algebra to be able to prove this theorem without 
having recourse to writing the matrices out in full. Hence 


(AB)-“(AB) = B“A“'AB = BB = BB = I 
and, as an additional (but unnecessary) check, 
(AB)(AB)*' = ABB“‘A* = ATA“! = AA =I 
which proves the theorem. 
Exercise 1. A diagonal matrix (say) 


has an inverse 


as can readily be shown direct multiplication. The expression is easil 
generalized pathitae of Sd order. ‘ = a 

Exercise 2, The inverse of the unit matrix I is the unit matrix itself (as, 
naturally, one would expect it to be). 

When calculating the reciprocal of a matrix, the work should be 
undertaken systematically as follows. 

Step 1. Calculate the determinant of the matrix A. If det (A) = 0 
no inverse exists. 

Step 2. Transpose the matrix, i.e. interchange rows and columns. 

Step 3. Replace each element a,, by its minor M,, (M,, is the 
subdeterminant derived from det (A,) by deleting row r and 
column s)). 

Step 4. Multiply each minor by +1 or —1 according to the 
chequerboard array of signs (see Table 3.2, p. 22). The resulting 
matrix is related to A by being the matrix in which the components 
are the cofactors of the corresponding components of A,; this 
matrix is often called the adjunct of A (Aqaj)- 

Step 5. Finally, each element of the adjunct is multiplied by 
1/det (A). 
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Exercise 3. Calculate the inverse of 


21 -2 
A= ol 1 
=, 0.0 


Step 1. det (A) = —3, so that A~ is defined. 
Step 2. Transpose the matrix— 


20 1 
A=4 11,0 
—21 0 


Step 3. Replace each element of A, by its minor— 


oe Ores 
1 =—2 2 
1 12 


Step 4. Change the signs of the elements of the matrix of minors according 
to the chequerboard pattern— 


0.3 
Aus = 4-H? —2 
tH | 2 
Step 5. Multiply Aqay by 1/det (A) to get A“— 


1f 90 -3 
Aiea 12 2 
3 \—£ 1 2 


As a final check, AA“ or A“? A should be computed. 
The following theorem proves that the operations transposition and inversion 
commute. 


Theorem 18. The inverse of the transpose of a (square) matrix 
is equal to the transpose of the inverse of the matrix. Thus 


(A)* =(A>), (=A) 


Proof. Post-multiplication of A, by (A~), yields AA“), = 
(AA), = I, = I (by Theorem 14), which proves the theorem. It 
is left to the reader to convince himself that (A7), is also the left 
inverse of A,. 

The question of the inverse of a singular matrix, i.e. a non-square 
matrix or one with zero determinant, will be discussed in Section 4.6, 
p. 45. 


PROBLEMS 
3.1. Show by detailed calculation that eqn. (3.2) follows from eqn. (3.1) when 
we make use of the fact that the first r row vectors of the matrix span the complete 
set of row vectors. Hint. Write the (r + 1)th s-dimensional row vector as a linear 
combination of the r s-dimensional row vectors of rectangle a, Fig. 3.1, and 
substitute in eqn. (3.2). 
3.2 Discuss the statement in Exercise 3, Section 3.7, in the light of Theorem 15. 
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3.3. Prove that det (—A) = (—1)" det (A), where is an n-by-n matrix. 
by te ine uit ecco age a 
3.5. Extend Theorems 14 and 17 to any number of matrices. 
3.6. Prove that when a matrix is symmetric, then so is its inverse. 
3.7. Investigate the conditions under which A and D commute, where D is 
a diagonal matrix and A a non-diagonal, like matrix. 
3.8. Let A be an n-by-n matrix and let A(A — I) = 0. Prove that 
r(A) + rA—D=n. 
3.9. Let A and B be square non-singular matrices. Prove that if these 
commute, then so do A~! and B-!, and also A and B>, 
3.10. Suppose that the variables y, and yg are linear functions of the variables 
x, and xy: 
N= 1—% 
Ya = 2x, — Xs 
ae by elementary methods a set of equations giving the x; as functions of 
Me 
3.11. Express the linear substitution given in Problem 3.10 in matrix form, 
Y = AX, and discuss its invertibility. 
3.12. Let the x; of Problem 3.10 be linear functions of a set of variables z): 
= 224+% 
xX, = 2 — 2 
Solve the equations for z; by elementary means. Express by direct substitution 


the y; as functions of the z;, where the y, are the variables mentioned in Problem 
3.10. 


3.13. Express the linear substitution of Problem 3.12 in matrix form, X = BZ. 
Determine a matrix C such that ¥Y = CZ. Is this substitution invertible? If so, 
calculate the inverse. Note how the consecutive application of linear substitutions 
leads naturally to our definition of matrix multiplication (Section 3.7, p. 24). 


3.14. Can the following substitution be inverted? 


n= Ut % 
Va = —Xy + 2xy 
Ys= 2xy—- 


3.15. Combine the substitutions given in Problems 3.14 and 3.12, and check 
that the result tallies with that derived by matrix multiplication. 


3.16. Test the validity of the associative principle by calculating (AB)C and 
A(BC), where 


2 0 =} 2 
(i) anfi 1 2) e-{ 3} c={1 0 -1} 
2 -1 0 -1 


=] —2 
(ii) anf i), B={l -3 6}, c-{ i 


Se  — 


a 
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3.17. Test the validity of the associative principle by computing the values of 
VA(WV,)W) and (V.W)(V,W), where 
V,=(1 0 2 —1) and W,=(2 1 -1 2) 
Also, verify that V.WV,W = V.WW,V. 
3.18. Show that the product of two scalar products can be rewritten as 


indicated— 
(P.QYR,S) = P(R,SDQ 
and test the result by substituting the values P, =(—1 1 1),Q,=(2 1 2), 
R,=(-1 2 1t)andS,=(-I 0 1). 
Compare this result with the derivation of eqn. (8.12), p. 96. 
3.19. Calculate AB and BA, and show that 


det (AB) = det (BA) = det (A) det (B), 


Lee 2 2-1 2 
where A=,4-1 2 1> and B=41 me oS 
01 4 1 2.5 


3.20. Show that AA, and A;A are symmetric if A is any square matrix. 
3.21. Let A be a skew a-by-n matrix. Prove that A" is symmetric when n is 
even, and skew (or anti-symmetric) when n is odd. 


CHAPTER 4 


General Solution of Simultaneous 
Linear Equations 


4.1. Solution of n Equations with n Unknowns 


We have now developed all the mathematical tools required to 
attack the problem foreshadowed in Section 2.6, p. 13. 

As a simple preliminary problem let us take a system of » linear 
equations with n unknowns, x;,. . ., X,- 


4X + AygXy +... + AyX_ = Dy 
Ay X Fb AX +. «+ AgyX_ = by 
d 3 miats odt. that be . (4.1) 


OnyXy + AngXe +. «+ AnnX, = 5, 


By considering the coefficients of x; as a column vector A; we 
are able to condense eqns. (4.1) to 


x%yAy + %Agt+...+%x,A,=B. « (4.2) 


and to formulate the problem in the language of geometry: Can 
the n-dimensional vector B be expressed as a linear combination 
of the n n-dimensional vectors A,? 

If we assume that the n A-vectors are linearly independent, they 
span m-space, which must contain B, and B can therefore be written 
as a unique linear combination of the base vectors A;. The equations 
have thus one and only one solution. 

With the help of matrix multiplication, eqn. (4.2) can be set out 
even more concisely as 

AX=B : : : - (4.3) 


where A is the matrix formed by joining together the n A-vectors 
to form an n-by-n matrix A. 

To find the solution we simply pre-mulitply eqn. (4.3) by Av? 
(which is defined, since det (A) # 0) and thus get 


ATAX=I1X=X=A“B. , . (4.4) 
33 
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In full, this equation reads 


% {4y Ag - « Any) [By 
Xg l Ayg Agog - +» Ang| | de 
heed? Ls inauiiiod |i 

Xn Ai, Asn - + Ann) lOn 


big 4 bgAgy ck sca By 
1 |Or4i2 + bedoo +... +d, 
~~ det (A) i xr 


An 
Ang 
# (4.5) 
BiAin + DeAan +. + By Agn 
Thus x; = (b;Ay; + by4g; +. . « + b,A,,;)/det (A) 
From Theorem 9, p. 20, it is clear that the numerator of this 


expression is derived from the determinant of A by substituting 
vector B for column A;. We now recapitulate the above results. 


Theorem 19 (Cramer's Theorem). When the determinant det (A) 
belonging to a system of n linear equations with n unknowns is 
non-zero, the system has a unique solution given by 

X=A"B 
or xX, = det (B,)/det (A) 


where det (B,) is the determinant obtained when vector B is sub- 
stituted for column A, in det (A). 


Exercise. Solve the equations 


2x —2y+ z=-3 


Written in matrix form they become 


1 1 1) {x 
2 OD 2ray 
2,—2 i Zz. 


ll 
! 
won 
path as 
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det (A) = 2(4 0); therefore A exists and the equations have a unique 
solution. A-? is calculated as described in Section 3.9, p. 28. 


4-3 2 
At=3{ 2 -1 0 
=A a, 


(ob 3-4 


If, however, we are concerned only with (say) the unknown y, we apply the 
second part of Cramer's theorem and get 


hoi 
2 “02 
2 Ao 1 
= ato 
1 aa 
2 «0.2 
2 23°49 


which tallies with the result obtained by matrix multiplication. 


4.2. General Solution of Simultaneous Linear Equations 


In general, » linear equations with m unknowns can be written 
vectorially as 
MAL + Ag+... +%mAnp= Bo. - (4.6) 


where the A, and B are n-dimensional vectors. 
The conditions of solvability are given in the next theorem. 


Theorem 20. The necessary and sufficient condition that eqn. (4.6) 
has a solution is that the ranks of the manifold spanned by the 
A-vectors, and of that spanned by the A-vectors and vector B 
together, are equal. 

Geometrically speaking, the vector B must lie in the space 
generated by the vectors A,. 

The necessity of this requirement is implied by the equation itself. 
To demonstrate its sufficiency, let us assume that the condition is 
fulfilled and that the rank of the column vectors A; is r. Further, 
let us also suppose that the equations have been rearranged and the 
unknowns reordered so that the first r columns and the first r rows 
of the matrix 

Avs (AVA. SAR) 


are linearly independent (see Fig. 3.1, p. 16). 
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Written out in full, eqn. (4.6) becomes 


1 A, DY ra 
7G 1 p+ +X ft Xp Ge ae p+ 

sad Fray Bsa ra 

Gar Qn Qn ptt 
am by 

+ Xm 44pm f= 1b, 

Gsm Drs 
a by 


If n> r, the last m — r equations are linear combinations of the 
first r equations; thus any solution of the first r equations will 
automatically satisfy the remainder. We can therefore ignore the 
last n-r coordinates in each column vector and write the system 
of equations as 


XAl +... AX AL + XA be. + xX,A, = Bo (4.7) 


where the A’ and B’ are r-dimensional vectors. 

When r = m, this system is identical with the one dealt with in 
Section 4.1, p. 33, and it therefore has a unique solution which can 
be determined by Cramer’s method. 

In the case where r < m, we can assign arbitrary values to the 
last m-r unknowns, X,43,.. -; Xm; and remarshal the vector 
equation as follows— 


XAT +... +.x,A, = Bo — GAjy. 6. = tA 
or AXP aR SA ea Al . (48) 


where A’ is the r-by-r invertible matrix formed from the r indepen- 
dent vectors Aj,...,A;; X’ is an r-dimensional vector with 
coordinates X45. 0... %-) ANd ty = Aya. s oy Agee = Xm ALC IN-T 
arbitrary parameters. 

Thus, for any given set of the m-r unknowns, X,,1, . . +» Xims 
eqn. (4.8) has the unique solution 


Res (ANNE Teale: some $e) . (49) 
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To summarize the above results, we can formulate another 
theorem. 


Theorem 21. If B in eqn. (4.6) belongs to the manifold determined 
by the m vectors A,, and if the rank of this manifold is r, the equation 
has a unique solution when r = m and an (m-r)-fold infinity of 
solutions (i.e. a solution containing m-r arbitrary parameters) when 
r<m. 

If B does not belong to the vector space spanned by the A,, the 
equation has no solution. 


Exercise 1. Solve the equations 


x+ yt3z= 6 
2x+3y+ z= 8 
4x + Sy + 7z = 20 
x +8z=10 


The augmented system matrix {A,A,A,B} is 


one w 
SB aa 


which, by linear operations, reduces to 


the rank of which is 2 (Section 3.6, p. 22). The first two columns and the first 
two rows of the system matrix are independent (they are not proportional); 
thus B belongs to the space spanned by the A;, and we can ignore the last two 
equations and substitute a parameter ¢ for the third unknown z. This leads to 


1 Gh (t=4} 


which when pre-multiplied by 


j ee SVs 3 - 
ese tie a 
Pe ees 3 - 6—3\ __ f 10-8 
yf ~\—-2  1f 8— rf = 1-44 5 
The complete solution can now be written 


iB 


It comprises one arbitrary parameter (there exists a single infinity of solutions 
to the equations). 


gives us 
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Exercise 2. Solve — 
2x 


6 
—3 
7 
13 
—3 


munud 


the rank of which is 3. The determinant formed by the coefficients of the un- 
knowns in the first three equations is non-zero; hence the A-vectors are indepen- 
dent and span a 3-space which contains B. We can thus ignore the last two 
equations, so that the system becomes 


2) 0. - 2) fx 6 

0 1 —2byyb= 1-3 

1 1 4) (z 7 
2 0 a 2-2 -2 
Oia, a Berea or ie ed 
1 =-1 4 -1 2 2 


Thus, by pre-multiplication, 


ee eae 


The equations have a unique solution. 


Exercise 3. Solve the system of equations 


2x—3y+z=1 
2x+ y =0 
3x+2y+z=1 
6x + 3y+2z2=2 
The augmented system matrix 
243 1 1 
258 0 0 
ee age Oa | 
Ce S01 2 
reduces to 
O30) 02 
oD 0.0 
-9 0 00 
0 0 =-1 0 


the rank of which is 4. This immediately shows that B does not lie in the 3-space 
spanned by the A;. 
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The equations therefore have no solution (they are said to be contradictory). 


Note. The preceding exercises have been presented in such a manner as to 
enable the reader to visualize geometrically what was being done algebraically. 
To make the position quite clear, however, we shall give a brief summary of our 
procedure in purely geometric terms. 

A,, A,, A; and B in Exercise 1 are coplanar, as evidenced by the fact that the 
rank of the augmented matrix was 2. This permitted us to project the problem 
onto a plane by ignoring the last two equations (i.e. the components of the 
vectors along the third and fourth axes). We thus reduced the problem to that 
of resolving vector B into components along three axes in a plane. This was done 
by allocating an arbitrary factor ¢ to one (any one) of the A; (any two of which are 
Pe eee and then resolving the combination of this vector and B in terms 
of the two remaining vectors. Hence, the solution contained one arbitrary 
parameter. 

In Exercise 2 we were required to express a 5-dimensional vector B as a 
linear combination of three 5-dimensional A-vectors. A study of the rank of the 
system matrix proved that B lay in the 3-dimensional subspace of 5-space spanned 
by the A;. The problem had a unique solution and could be simplified by shedding 
two dimensions, thus projecting the vectors into a 3-space. 

Exercise 3 posed a problem similar to that treated in Exercise 2, except 
that in this case B lay outside the 3-dimensional subspace spanned by the A- 
vectors. The equations had, therefore, no solution. 


4.3. Nullspace of a Matrix 


A special situation arises when B = 0 and eqn. (4.6), p. 35, 
becomes 


Aas: 2. al a8 . . (4.10) 


It is obvious that this equation will always have the solution 
XypS MH... SH Xy, = 0. 

To obtain the complete solution, we can proceed as described in 
Section 4.2. When r = m, the A-vectors are independent and eqn. 
(4.10) will have only the trivial solution mentioned above. When 
r <™m, however, we can assign arbitrary values to the m—r 
unknowns X,43,. + -;X;, and employ eqn. (4.9) by substituting the 
r-dimensional nullvector 0’ for B’. 

This yields the expression 


X= —14(A AL... ty (AVIA, . (4.11) 


from which it is clear that eqn. (4.10) has an (m — r)-fold infinity of 
solutions. 

Up to this point we have looked upon the m x, as coefficients of 
the m column vectors A, We shall now interpret these numbers 
as the coordinates of an m-dimensional vector X. 

Referring to eqn. (4.11), and bearing in mind that the last m — r 
coordinates of X are arbitrary parameters, it is readily seen that X 
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is an arbitrary linear combination of m — r vectors of the form 


Riss {eee | G@=1,...,m—r) . 4.12) 
i 


where the U, are the (m — r)-dimensional unit vectors. 

From the presence of the m — r unit vectors it is obvious that the 
R, are linearly independent; this can be seen from the fact that the 
bottom (m — r)-by-(m — r) sub-matrix of the m-by-(m — r) matrix 
(RR, . . . R,,,) is a unit matrix the rank of which is m — r. 

To recapitulate the above results: the solutions of the equation 


AX=0 p 7 ‘ - (4.13) 


where A is an n-by-m matrix, X an m-dimensional vector and 0 the 
n-dimensional nullvector, fill an (m — r)-dimensional subspace of 
m-space, where r is the rank of A. The rank of the nullspace of a 
square matrix is termed the mullity of the matrix. 
When r = m, eqn. (4.13) has only the trivial solution X = 0. 
Anticipating the contents of Section 5.2, p. 51, we can say that 
eqn. (4.13) requires X to be orthogonal to all the row vectors of A. 


Exercise 1. Solve the equation 


21 -2 e 0) [x 
Osi 1. 80! Ny 
AX=4-1 0 0 —2 -Il}4z-=0 
22 1 5 3) |u 
he leet nosteng2!) AG 


By reducing the system matrix we find that r(A) = 3, and by checking the top 
left-hand 3rd-order subdeterminant of A, it is seen that the two last equations of 
the set can be ignored. Thus, by treating u = s and v = f as two independent 
arbitrary parameters we arrive at the equation 


Te wal 


which has the solution 


x —2 -1 
y -1 0 
zp=sy 1p +t4—-1> =sR+1Q 
u 1 0 
v 0 1 


where R and Q span the nullspace of A. 
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Exercise 2, Discuss the (non-simultaneous) equations 


2x—-y+tzt+u=0 F - 5 + (4.14) 
and ax—ytz+us2 . : \ « (4.15) 
In both equations m = 4 and r = 1; hence the solutions to eqn. (4.14) will fill 
a 3-dimensional subspace of 4-space. Following the procedure given in Section 


4.2 and in this section, we find that the solution space (the nullspace of the 
1-by-4 matrix A) is spanned by the three independent vectors— 


i % 3 
Ri=jor, R= yp and Ry = 0 
0 0 1 
Using eqn. (4.8) we find the solution of eqn. (4.15) to be 
1 1+34 — tm — Hy 
X= 10) 4 AR, + HR, + 45R, = a 
0 ty 


It should be noted that the complete solution of an equation of the type 
AX = B(+ 0) is equal to one solution (any one) of the equation plus the null- 
space of A (i.e. the complete solution of the equation AX = 0). 


We now define the complementary space (nullspace) of a manifold 


spanned by p n-dimensional vectors, V;,. . ., V,, to be the nullspace 
of the p-by-n matrix 


Ve 


Together, a manifold and its complementary space fill all n-space. 


4.4. Union and Intersection of Vector Spaces 
Let two linear vector manifolds in n-space be given as follows— 


E, spanned by V;,...,V, and £, spanned by W,,.. ., W, 


The maximum number (s) of linearly independent vectors that 
can be selected from the two sets is said to span the union (join) of 
the two spaces. The union is the space of lowest possible dimension 
containing both £, and E£,. 

The nullspace of the union of the nullspaces of E, and E, is the 
intersection of E, and E,. It is the space of highest possible dimension 
that can be contained in (is a subspace of) both E, and E£,. 

Taken with a pinch of salt, Fig. 4.1 may prove an aid in visualizing 
the concepts of union and intersection. The n horizontal divisions 
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can be taken to represent m independent n-dimensional vectors in 
terms of which £, and E, can be expressed. : 

If the ranks of E, and E, are p and q respectively, the rank of 
their union is s and that of their intersection /, it is readily seen that 
ptq=s+t 
n 
Union (s) 


Nullspace 
of Ep 


ee of &y 


Fic. 4.1. SCHEMATIC REPRESENTATION OF THE CONCEPTS OF 
UNION AND INTERSECTION 


Exercise 1.* Find the union and intersection in an £; of an E, spanned by 


2 1 2 
1 0 1 
V,=407, Vea= 4 2+ and V;=41 
1 -1 0 
1 1 0. 
and an E, spanned by ; , 
2 1 
W,=4;-1; and W,=42 
2 1 
0. 1 


By linear operations the rank of the compound matrix (V,;V,V,;W,W,) is found 
to be 4. V,, yr V, and W, are shown to be independent, and they can therefore 
be chosen as a base for the 4-dimensional union of E, and £,. 


From the equations 

V, 

{rat X=0 and Tri} x =0 

a 
Bt. 


* In this and in many of the following exercises we shall not describe in detail the 
steps by which we arrive at a result, but merely outline the method employed or refer 
to some algebraic technique which has already been demonstrated. Each exercise 
is thus virtually a problem. 
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the nullspaces of E, and £, are found to be spanned by 


=1 —3 
1 5 
Y= 1}, Vo= 1 
1 0 
0. 1 
5 0 2 
-7 -1 -3 
and W, = lr, Wa= 07, We= 0 
0 1 0 
0. 0. 1 


respectively. 


The rank of matrix (V.V;W,W,W,;) is 4, and by computing the correspondin; 
determinant, V,, V;, W, and W, are found to be independent and are mice 
to span the union of the nullspaces of E, and E>. 

To obtain the nullspace of this union (which is the intersection of E, and E,) 
we could solve the equation 


Mies Desew ne ume come ay en atAle) 


but an easier way is to choose the coordinates of X as the cofactors of the 
elements in the last column of the determinant det (ViV;W.W,0). By Theorem 9, 
p- 20, the vector derived in this manner will satisfy eqn. (4.16). This method 
yields 


The intersection of Ey and £y is a straight line. 


As a further exercise the reader should sketch a diagram similar 
to Fig. 4.1. 

When working with 5-dimensional vectors, as we did in the pre- 
vious exercise, we must of necessity lean heavily on our algebra, 
and can only vaguely visualize the steps we are taking by analogy 
with the familiar geometry of Euclidean 3-space. 

As a contrast to the 5-dimensional problem of Exercise 1, we 
shall now pose a simple 3-dimensional problem which can readily 
be pictured. We shall describe our method of solution in words 
and give the calculated results, but the actual calculations are left 
to the reader. 
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Exercise 2, The problem is to find the union and intersection of E, and Ey 


spanned by 


cof Bh = moG mG 


respectively. + 

By checking the appropriate determinants we can see that no three of the 
vectors V;, V2, W, and W, are coplanar; their union is thus the whole of 3-space. 
V, and V, are independent and contain a plane P; their complement is a line 
L, perpendicular to P, and determined by the vector 


“(4 


Likewise, W, and W, span a plane P’ and their complement is a line L’, per- 
pendicular to P’, and lying along the vector 


m3 


The union of the nullspaces of Ey and £3 is a plane through £ and L’. The 
complement of this space is a line L’, orthogonal to both L and L’, and deter- 


ined b 
mined by Baa 
Q=; 9 
2 


L’ is at right angles to Z and therefore lies in P; by a similar argument it must 
also lie in P’. Hence L” is the line along which P and P’ intersect. 


4.5. Non-Centred Vector Spaces 


The vector spaces introduced and defined in Section 2.5, p. 11, 
are said to be centred because they contain the origin 0. 
A vector space defined by the equation 


X= Ay +t4Ayt.. -tnAn ; « (4.17) 


where the A, (i =0,1,...,m) are n-dimensional vectors, and 
ty, . « +» tm independent arbitrary parameters, is called non-centred 
when it does not include 0. 

Obviously, the sufficient condition that the space defined by 
eqn. (4.17) shall not include the origin is that the set of vectors 
Ao, Ay, - . »» Ay, are linearly independent. Hence n > m. 

Suppose we have two non-centred spaces, E, and £,, in n-space 
and wish to determine their intersection. 

Let £, be defined by 


X=Py+tPi,t+...+tyP, : . (4.18) 
and E, by X= Qo + 5,0, +... + 5,0, 2 - (4.19) 
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where each set of base vectors is independent and the ?’s and s’s 
are independent arbitrary parameters. 

A point of intersection of E, and E, will lie simultaneously in both 
spaces, i.e. 


Poth Py +... + t,P,= QQ) +50, +...+5,Q, 
or Py +... +t,P, —5Q,—.. -—5,Q, = Qy — Py (4.20) 


This equation can be discussed and solved by the method described 
in Section 4.2, p. 35. Generally the solutions will fill a space whose 
dimension will not exceed either p or q (whichever is the smaller) 
and never be less than p + q — 7. 

When p + g <n, E, may miss each other altogether, i.e. have no 
points in common. Compare in this connexion two £;’s in 3-space, 
at least one of which is non-centred (two straight lines which do not 
both pass through the origin). 


Exercise 1. Prove that an E,, and an E,_,, in n-space generally intersect in 
an Ey (a point). 

If the two spaces have no directions in common the set of vectors consisting 
of their m + (n — m) =n base vectors will be linearly independent and eqn. 
(4.20) will yield a unique solution which will determine the point of intersection. 


Exercise 2. Discuss the intersection in 4-space of the non-centred space 


1 0 2 
2 =1 0 
Oj; +4 2{+%#|-1 
1 2 1 


X= Pot hPy t+ Py = 


and the centred space 
2 
—1 
x 
3 


By means of linear column operations we find r(Q,P)P,P.) = 3, and 
1(Q, P,P.) = 2. Thus the two spaces have no point in common. 


X=5,Q, = 5 


4.6. Right and Left Inverses of Singular Matrices 


In Section 3.9, p. 28, it was shown that an n-by-n matrix A of 
rank n has a unique inverse A~' such that 


AA = ATA =I 
We shall consider here in greater detail why a singular square 


matrix cannot have an inverse. 


Let A be an n-by-n matrix of rank r <n and let us seek a post- 
factor X such that 


Xa 4e gn . . GS 
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It follows from the shape of the matrices A and I that X, if it 
exists, must also have n rows and n columns. 
By considering X and I as consisting of column vectors, we have 


Mist Spo Xor XD 


and I=(U,...U,...U,) 
where U, is an n-dimensional unit vector with its unit element in 
the ith place. 


Egn. (4.21) can now be broken down into n sets of n linear equa- 
tions with n unknowns— 
AX, = U, 


é 


. (4.22) 


Since r(A) = r(<n), the column vectors of A will span an 
r-dimensional subspace of m-space. Thus, for at least n — r values 
of i, the vectors U, will lie outside this subspace and the corresponding 
eqns. (4,22) will have no solution. Hence, eqn. (4.21) has no solution. 

An exactly analogous train of reasoning employing row vectors 
can be pursued to prove the non-existence of a left inverse of A. 

Another type of singular matrix is a rectangular matrix with more 
rows than columns or more columns than rows. 

Let A be an m-by-n matrix with maximum possible rank r(A) = m 
or n (whichever is the smaller). 

If we wish to define a right inverse of A according to eqn. (4.21), 
X will have to be an n-by-m matrix, which in turn makes I the 
m-by-m unit matrix. As before, we calculate X column by column 
by means of eqn. (4.22) which when stated in greater detail reads— 


XyAy + XyAg t+... + XyA, = U; . - (4.23) 


where the A’s and U, are m-dimensional vectors. 

When n < m, at least m — n of the unit vectors are not contained 
in the n-dimensional subspace of m-space spanned by the A-vectors, 
and therefore at least m — n of the m eqns. (4.23) are unsolvable. 
Thus for n < m no inverse exists. 

In cases where n > m, the A-vectors span the whole m-space 
(r(A) = m) and each of the m eqns. (4.23) has an (n — m)-fold infinity 
of solutions. Thus an m(n — m)-fold infinity of inverses exists. 


Exercise. Calculate the right inverse of A, where 
10 -1 
As H 1 i 


Xx X_ 
Let X= 1 Ys 
% 2 
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To determine column 1 of X we must solve equation 


19% ae { i} 
n= 
{i tn a { bs 0 
which is similar to the equation discussed in Exercise 1, Section 4.2. 
The solution, which we leave it to the reader to work out in detail, is 


1+ s 
X,=4-1-2s 
Ss 
Similarly, the equation for the second column of X has the solution 


t 
X,=41-2 
t 


The right inverse of A is thus 


1+ s t 
X= j,-1-—25 1-2 
s t 


4.7. The Factorized Inverse 


In this section we shall discuss a method of inverting large matrices 
which is fundamentally important in the field of diakoptics. 
Let the following matrix equation be given— 


aE ya ony aeetsy gos KAD 


where A is a large n-by-n matrix of rank , and suppose that it is 
possible to decompose A as follows— 


A=B+KPK, eer 
where B is non-singular and easily invertible, P is a p-by-p non- 


singular matrix, and K is an n-by-p matrix of rank p (<n). 
Eqn. (4.24) now becomes 


; BX + KPK,X = F 7 - - (4.26) 
or (since B= exists) 
X = BF — B“KPK,X : . (4.27) 
Pre-multiplying this equation by K,, 
K,X =K BF —K,B"KPK,X_.. . (4.28) 
Rearranging this equation and solving for K,X, 
K.X=(1+KB°KP)"K BF - (4.29) 
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Substituting (4.29) in (4.27), we find that 
X = [I — B°KP( + K.B°KP)“K ]B“F 
= [I — B“K(P* + K,B"K)"K,]B>F - (4.30) 
By comparison with (4.26) it is clear that 
At = [I — BOK(P* + K,B“K)"K JB" . . (4.31) 


Apart from the addition and multiplication of matrices, the in- 
version of A has been reduced to the inversion of two other matrices: 
B, which by hypothesis is easily inverted, and P which is appreciably 
smaller than A (p <n). 

Before the validity of eqn. (4.31) can be accepted, however, we 
must show that the inversion of I + K,B“KP (eqn. (4.30)) is per- 
missible, i.e. that ri + K,B“KP) = p. Post-multiplication by K, 
will not alter the rank of the matrix because r(K) = p. Hence 


K, + K,B"KPK, = K,1I + B“KPK,) 
= K(1 + B-(A — B)) 
=K,BA. : : . (4.32) 
the rank of which is p, since r(B-'A) = n (see the Exercise on p. 27). 


Exercise. Prove by direct multiplication that eqn. (4.31) is correct. 
Post-multiplication of A by this equation gives 


AA” = (B + KPK)[I — BOK(P 7+ K,BK)"K]B 
= [B—K(P> + K,B'K)K, + KPK,— KPK,BK(P-1+ K,B“K)"K JB 
= [B + KPK, — KP(P“ + K,B-'K)(P“' + K,B“K)"K,JB 
= (B + KPK, — KPK)B =I (QE.D.) 


As a further exercise the reader should check that the product 
AA is also equal to the unit matrix I. 


PROBLEMS 
4.1. Discuss the simultaneous linear equations 


ax+y—z+ u=6 
xty+z+4u=6 


4.2. Determine a such that the simultaneous linear equations 
x+2y—- z= @ 


Sey +z = =2 
2x +2z= 6 


have a unique solution. 
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4.3. Discuss the simultaneous linear equations 


x—- y= 5 
a+ y= 4 
—x+2y=-7 
x—3y= 9 
2x+2y= 2 
4.4. Determine the constants a and b such that the simultaneous linear 
equations 
x+ y+ z=-1 
- +2z= a 
x—2y—- z=-3 
wx+3y+ z= b 
—x+2Zy— ze 7 
have a solution. 


4.5. Determine the nullspaces of the matrices 


1 1 2 -1 2 3 1 2 -3 
A=40 2 -1}, B= 21 44, C= 2 2 =6 
1-1 1 Onk 2 -1 —2 #3 


4.6. Solve the equation AX = 0, where 


O DT apo St 
2-122 -1 
A=j)1 7 at dad | 1 
& MnOngeiz itp 
oe Seo 3 


4.7. Check that (X;),=(1 0 —1 2 1) is a solution of the equation 
AX = B, where B, =(0 3 1 3 —I)and A is the 5-by-5 matrix ox in 
Problem 4.6. Give the complete solution. 


4.8. Determine the intersection of the two manifolds 
X, =Ay + A; + Ay 
and X, = 5,B, 


2 1 2 0 
where Ay=4-57, Ap=4-2}, Ap=41}, B= 1 
3 1 1 =1 

4.9. Show that, if an n-by-n matrix has the rank r and the nullity s, then 


r+s=n. 


4.10. Prove that a linear manifold (vector space) and its nullspace (comple- 
mentary space) fill all n-space. . ileal: 


4.11. Apply the method employed in the discussion of the non-existence of 
the inverse of a singular matrix given in Section 4.6, p. 45, to the matrix 


1.2.0 
—{ 1 =3 
21 3 
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4.12, Calculate the left inverse of 


2 4 
a 
ee FG 
ff 1 


4.13. Let a non-centred 2-dimensional subspace E, of 5-space be determined 
{as in Section 4.5, p. 44) by the vectors 


2 1 = 
0 2 0 
A,=40+, Ay=}t—1} and A,=4 1 
ty) 1 -1 
1 ) 2 


Determine a 2-dimensional space through the origin which does not intersect Es. 


CHAPTER 5 


Orthonormal Matrices—Compound 
Matrices 


5.1. Outer Multiplication of Vectors 
From the manner in which matrix multiplication was defined it 
follows that two like (equi-dimensional) vectors can be compounded 
in two different ways. 
Outer (or dyadic) multiplication of two vectors A and B is written 
a ab,.. . ab, 
a, yh, . « . Aaby, 
ABy= 5). {6 bs. bye y. 

a Gaby: «x ab 
The result is a square matrix the rank of which is only 1, however, 
since all the columns (and all the rows) are proportional. 


5.2. Scalar Multiplication of Vectors 
When two like vectors are multiplied as follows— 
A,B = ayby + dyby +... + a,b, 
the result is a 1-by-1 matrix or scalar. The product is called the 
inner or scalar product of A and B. When A,B = 0, A and B are 
said to be orthogonal. 


If the scalar product of a vector by itself is unity, we say that the 
vector is normalized (the vector is of unit length)— 


AA=agta+...4¢@=1 


Any non-zero vector can be normalized by multiplication by 


I-V(A,A). 


Exercise 1, In plane Cartesian coordinates all unit vectors can be written 
in terms of a parameter v as 
cosv 
zi is a 
5 


1 


ee a 
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where 0 < v< 2z. For all values of v the vector 


—sin v 
B= { cos at 
will also be normalized and orthogonal to A. 


If any two of a set of vectors are orthogonal, the vectors are said 
said to be mutually orthogonal. 


Theorem 22. A set of mutually orthogonal vectors are linearly 
independent. 

To prove this theorem let us assume that the set of vectors 
Aj, Ag,. . ., Ay are normalized and mutually orthogonal. From 
the equation 


kA, + kgAg t+... +k A, =0 
we derive (by pre-multiplication by A,) 


ky AyAy + keAyAg +... + kyAyAg 
Se TO. Le, eed 


Hence k, = 0, and similarly k, = kg = . . . = k, = 0, which proves 
that the vectors are independent. 


From the above theorem it is clear that a set of mutually ortho- 
gonal n-dimensional vectors cannot number more than 7. The unit 
vectors Uj, U,,. . ., U, are an example of such a set. 


Theorem 23. A set of g n-dimensional mutually orthogonal 
vectors (¢ < n) can always be augmented by n — q vectors to form an 
orthogonal set of n vectors. 

Let A,,. . ., A, be g orthogonal vectors. An additional vector 
Aj, must satisfy the g equations A,,A,,,;=0,.. ., AyAgu = 0 
with n unknowns (the coordinates of A,,,). These equations can 
be written 

Ay, 


2t 
An =aA =H 0°  « . GA) 


Ag 

The g A-vectors are mutually orthogonal; thus r(A) = q, and 
eqn. (5.1) has an (n —q)-fold infinity of solutions from which 
Aj, can be selected. By induction the theorem is seen to hold in 
all cases where g <n. 


| 
| 
| 
| 
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As a corollary to Theorem 23 the following statement is readily 
seen to be true: In a p-dimensional vector space (p > 1) it is always 
possible to select a set of p mutually orthogonal vectors. 

The first vector, A,, of the set can be chosen arbitrarily. The 
second vector, Ay, must lie in the complementary space of A, 
(a (p — 1)-space). To determine a third vector we can choose any 
vector in the (p — 2)-dimensional complement of the manifold 
spanned by A, and A. This process can be continued until p vectors 
have been found. When determining the last vector of the set A,, 
we have no longer any choice of direction since A, must lie on the 
unique line forming the nullspace of the set A,,. . -, A; 1- 


Exercise 2. Calculate a set of orthogonal 3-dimensional vectors. 
We have complete freedom in selecting the first vector of the set, so let us take 


sf 


The coordinates x, y, z of the second vector must satisfy the equation 
2x +y +2z=0 


which is the equation for a plane through the origin and normal to A,. Suppose 
we take x = 0, y = —2andz=1. Then 


“(4 


A, and A, span a plane and A, must therefore lie along the line through the 
origin and perpendicular to the plane; the only choice left to us is that of the 
magnitude and orientation of A;. By means of the method used in Exercise 1, 
Section 4.4, to calculate the intersection of an £, and an E, (which in the 3- 
dimensional case becomes identical with the formula used to compute the cross- 
product of two vectors), we find that 


5 
ss {4} 
—4 
5.3. Orthonormal Matrices 


A square matrix in which the column vectors are normalized and 
mutually orthogonal is termed an orthonormal matrix. 

Let Aj,. . ., A, be the column vectors of A. The condition for 
orthonormality is 


1 wh = 
AyAg = GypMys +» © 1 ayn = 0 ae, ; vie 


These n® formulae can be written concisely as 
AA=I.. 5 : = (52) 


3—(T.1046) 
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Thus the transpose of an orthonormal matrix is identical with its 
inverse. Since det (A,) = det (A), it follows the det (A) = +1 or —1. 

Also, because a square matrix and its inverse commute, AA, = I, 
so that the row vectors of A are also normalized and mutually 
orthogonal. 

A few important properties of orthonormal matrices are readily 
verified— 


(i) If A and B are orthonormal, their product AB is also ortho- 
normal. 

Proof. (AB)(AB) = B,A,AB = BIB = BB=I1 (Q.E.D.). 

(ii) Multiplication of orthonormal matrices is associative. This 
follows immediately from the general associativity of matrix 
multiplication. 

(iii) The unit matrix is orthonormal. 

Proof. YI = MW =I. 

(iv) The inverse of an orthonormal matrix is itself orthonormal. 

Proof. (A),A™ = (A) A7 = (AA) =I =1. 


Our reason for including the apparently unnecessary property 
(ii) will become clear when we define a mathematical group (Section 
6.5). 


Exercise 1. In Exercise 2, Section 5.2, we selected three orthogonal vectors 
in 3- a The compound matrix A =(A,A,A,) formed from these vectors 
is orthogonal but not orthonormal. The reader should check the products 
AA, and A,A (the second is a diagonal matrix). 

A can be converted into an orthonormal matrix by normalizing its column 
vectors. This results in 


2/3 0 5/5) 
A’=41)3 -2/V5 —2/BV5) 
2/3 Afv5 —4](34/5) 


Note that the row vectors of A’ are unit vectors and mutually orthogonal (which 
the row vectors of A were not). 


Exercise 2, In 2-space all orthonormal matrices are given parametrically by 


A = {0082 *F sin v 
~ \sinv +cosv 


5.4, Partitioned Matrices 


On a number of occasions we have combined a set of vectors to 
form a matrix. Conversely, it is feasible to partition a matrix into 
submatrices. However, when partitioning the factors of a matrix 
product, care must be taken to ensure that the partial products that 
result from the process are defined. 


5.4. PARTITIONED MATRICES 55 


A little experimentation will show that the rows of the pre-factor 
and the columns of the post-factor can be partitioned ad lib., whereas 
the columns of the pre-factor and the rows of the post-factor must be 
subdivided according to the same pattern. : 

This principle is best illustrated by means of a sketch (Fig. 5.1). 

The two matrices to be multiplied are indicated by rectangles. 
If their product is defined, the number of columns in the pre-factor 
is equal to the number of rows in the post-factor. This is the only 
condition governing the “‘shape” of the factors. 


Fic. 5.1. PARTITIONING A MATRIX PRopuCT 


We can now subdivide the matrices vertically and horizontally, 
as shown by the full and broken lines, and multiply them together 
as though the blocks into which they have been partitioned were 
scalar elements instead of submatrices. The position and number 
of the broken lines are not limited in any way, but the position of the 
full lines is subject to the condition that the partial products AE, 
BG, CF, DH, etc., shall be defined. 

It is easily verified by inspection that the matrix arrived at by 
partitioned multiplication is identical with the one obtained in the 
ordinary way. 


Exercise. The inverse of a partitioned matrix of the type 
KTO=0 
A=;0 L O 
oOM 
where K, L and M are square but not necessarily like matrices, is 
EK oO. 'O 
At=,0 L oO 
G0: M+ 
Compare this result with that of Exercise 1, Section 3.9, and note also that 


det (A) = det (K) det (L) det (M). Thus A~ is defined only if all three deter- 
minants of the square submatrices are non-zero. 
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5.5. Partitioned Inverses 


One aspect of the method of subdivision, the partitioned inverse, 
is important enough to warrant a separate section. 
Suppose we have two non-singular matrices Z and Y that are 
each other’s inverses; i.e. 
ZY=1=YZ . ‘ ; who) 


Furthermore, let Z be given and Y unknown. By means of 
partitioning it is now possible to find Y without having to determine 
Z~ explicitly. This is done by partitioning Z and Y as follows— 


Z, Z.\ f¥, ¥.| __s1 O 
Z, zh Y, ys Sopa) ne) ee 
where Z,, Z,, Y, and Y, are square and the two unit matrices in the 
right-hand member of the equation are also square but not neces- 
sarily like. 
Multiplying the two matrix rows of Z by the first matrix column 
of Y yields the equations 


ZY, + ZY, =1 : : Gis) 

and ZY, + ZY, = 0 : 4 . (5.6) 
Solving this equation for Y, gives 

Y, = —Zy ZY, iy et 201557) 

and, substituting this in eqn. (5.5), and solving for Y,, we find that 

Y, =(Z, — Z,Zg4Z,) : . (5.8) 


and, from eqn. (5.7), 
Yg = -ZZ(Z)— ZZ 2)  . —. (5.9) 


In order to find Y, and Y, in terms of the matrix elements of Z, 
we could multiply the matrix rows of Z by the second matrix column 
of Y. Such an approach leads to formulae which can be derived 
immediately from eqns. (5.8) and (5.9) by interchanging the indices 
1 and 4, and 2 and 3. 

We shall, however, follow another path by employing the fact 
that Z and Y commute. From the identity YZ = I we get 


Y,Z, + Y,Z, = 0 : ; . (5.10) 

which yields 
Vp = -YyZoZ7 = —(Z, — Z.Zp1ZyAZZy4 . (5.11) 
and VgpV Ey eT ose cae: eS) 
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which finally gives us 
Vy = (I — Yg2q)Zy7 = + Zp Zs(Zy — ZeLg Zs)" Za)Zg* 


« 3.33) 
Exercise. Invert the matrix 
Pod Ons 
Ord oO 3 
BAe 
ot °C. 2 


by partitioning. : : 
We shall subdivide the matrix into four 2-by-2 submatrices. The first matrix 
to be computed is 


fee pave ee 
Zt=) 9 + =if 01 


Y= @ = Zterey'= {5 _3} 


Next we compute 


0 — 
Y, = -Y,Z:.2,7 = 5 4 
10 
Yy = —Z ZY, = { i} 


Y=a-¥2yz={~> _T} 


The actual calculations, which are quite straightforward, are left to the reader. 


1 3s Ob 5 
: 0-2 0 3 
Finally, Yeats get 50 


0 1 0-1 


A check will show that the product of Z and Y is equal to the unit matrix. 


PROBLEMS 


5.1. Adda third vector Ay to the set of vectors A, and A, with coordinates 
(2, 1, 2) and (1, 0, —1), respectively, so as to form an orthogonal system. Con- 
struct an orthonormal matrix from the three vectors. 


5.2. Study the properties of the square matrix U =(U,U,_,. . .U,U;), 
where the U, (i= 1, 2,..., ”) are the n n-dimensional unit vectors. Is U 
orthonormal ? 


5.3, Investigate the properties of an n-by-n matrix, P, formed by Permuding 
the rows of the n-by-n unit matrix I, Show that P is orthonormal and that pre- 
multiplication of a square matrix, A, by P permutes the rows of A in the same 
manner in which the rows of I were permuted to form P. 


5.4. Study the properties of P as a post-factor. 
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5.5. Demonstrate that the matrices 
0.10 00 -1 
A=4;-1. 0 0} and B=40 1 0 
001 10 0 
are orthonormal and show that AB * BA, 


5.6. Show that At = Bt = (AB)® = (BA)® = I, where A and Bare the matrices 
of Problem 5.5, 


5.7. Show that matrices of the type 


cosu sinu 0 0 
—sinu cosu 0 0 
0 0 cosv —sin v 
0 0 sinv cosy 


are orthonormal. 


5.8. Give another proof of the fact that the inverse of an orthonormal matrix 
is itself orthonormal by making use of the identity A“? = A,. 


5.9. Prove that the matrix A = (I — B)(I + B)-!, where B is skew-symmetric, 
is orthonormal. Hint. Use the fact that I — B and I + B commute. 


5.10. Prove that, if B is skew-symmetric, then det (I — B) = det (I + B). 
5.11. Invert the following matrices by suitable partitioning— 


1 1,4 
A=4;2 02 
2 =—2 1 


was inverted by partitioning. It was tacitly assumed that the square submatrices 
Z, and Z, were both invertible. Discuss whether it can be inferred from 
det (Z) A 0 that det (Z,) A 0. 

5.13. Test the method of partitioning the matrices of a matrix product by 
subdividing the following matrices according to the rules outlined in Section 5.4 
and compare the result with that obtained by ordinary matrix multiplication. 
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CHAPTER 6 


Linear Transformations and 
Linear Vector Functions 


6.1. Coordinate Transformations 


AN n-dimensional vector V can be written as a unique linear com- 
bination of n-dimensional linearly independent vectors A,. 


V=v,A, + mAg+...+2,A, 5 - (6.1) 


where the A; form a base for the m-dimensional manifold containing 
V. The numbers v,,. . ., v, are the coordinates of V in the coordin- 
ate system formed by the A,. 

Yy 


PSO HO Gino tows nae 


vy 


Let us now express each A-vector as a linear combination of 
new independent vectors Aj,.. ., Aj,. The relationship between 
the two sets of vectors can be stated in matrix notation as 


(A,...A,) = (Aj. . . ALM ara (3) 


where M is a non-singular n-by-n matrix. 
The question then arises, How is the vector V expressed in this 
new frame of reference? Combining eqns. (6.2) and (6.3), we get 


vy Vy 
V=(A,...4,)4- b= (Al... ALM 
Up v, 
Uy 
te, He. nes . (6.4) 
Up 
in which vj,. . ., v}, are the coordinates of V in the new frame. 
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By comparing the third and fourth members of eqn. (6.4), and 
bearing in mind that the A’-vectors are independent, we see that 
the coordinates of V transform according to the expression 


v% vy 


Un Un 


After pre-multiplication by M~ and subsequent transposition (in 
order to make the transformation formula functionally identical 
with that of eqn. (6.3)), we arrive at 


Qy. - - Pp) = (v1. . . v,)(M>), : . (6.5) 


We note that the two expressions are identical in functional form, 
but that the place of M in eqn. (6.3) is occupied by M,* in eqn. (6.5). 
Transformations that behave in this way are said to be contragredient. 
The transformation of the base is conventionally termed covariant; 
that of the coordinates of a vector therefore becomes contravariant. 

When (and only when) M is orthonormal, M,;-! = M, and the 
distinction between co- and contravariance vanishes. 


Note. Contragredient quantities are frequently encountered in the physical 
sciences. The measure of a distance, for example, is a number indicating how 
many times a standard unit of length is contained in the given distance. The 
unit of length and the measure of a distance are contragredient. If we change 
from centimetres to inches, which are 2:54 times larger, the measure of a distance 
becomes 2:54 times smaller. On the other hand, the measure of a velocity and the 
unit of time transform in exactly the same way; they are cogredient. 

An excellent example of co- and contravariance is to be found in the method 
of pete electrical quantities from the primary to the secondary side of an 
ideal transformer. If the voltage is stepped up in a certain ratio the current will 
be stepped down in the same ratio (while the power remains invariant). 


Exercise 1. From the theory of 3-dimensional vector analysis it is well known 
that the cosine of the angle between two unit vectors is equal to their scalar 
product when the coordinate system is Cartesian (i.e. the base vectors are nor- 
malized and orthogonal). 

Generalizing this method to n dimensions, we may pose the question, How 
does the scalar product of two vectors transform when the base is subjected to 
the transformation given by eqn. (6.3)? 

Let V, and V, be two unit vectors. Then 


cos [(V;, Vs) = ViV_ = VilV, = Vi¢MeMV3 = Vi,G'Vs . (6.6) 
where G=M-IM" . ‘ : ‘ . (6.7) 


is termed the metric of the new coordinate system. 
G’ is symmetric since 


Gi = (MoIM~), = M-7.M,t = M"IM~ = G’ - (6.8) 
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Apparently the unit matrix is the metric of Euclidean space referred to a 
Cartesian coordinate system. Rearranging eqn. (6.7) to conform to the pattern 


of eqn. (6.3), we find that 
ImMGM .. . - « « 69) 


which indicates that the metric is doubly covariant. 

Also, from eqn. (6.7) it is readily seen that the metric is invariant (= I to 
orthonormal transformations. This is not surprising when we recall that an 
orthonormal transformation corresponds to replacing one Cartesian system of 
reference axes by another. 


Exercise 2. Let two sets of independent vectors A,, Ag, A, and Aj, A3, Ag 
be given in Euclidean 3-space, and let the A-vectors be orthonormal. The two 
sets are related by the expression 


Ot 
(A = (AIALADM = (A449 | 10 i 
210 


The coordinates of vectors referred to the two systems transform by means 


of the matrix 
1 2 —!1 
M7=4-1 —2 2 
-1 -1 1 
as given in eqn. (6.5). 
The metric of the A-system is I and that of the A’-system is 


6. Tit 
G=M7M7={-7 9 5 
ee 


Unit vectors along the first two axes of the A-system will have coordinates 
(1, 0, 0) and @, 1, 0), respectively, and transform into (0, 1, —2) and (1, 0, 1), 
respectively, in the A’-system. 

Check by means of eqn. (6.6) that the vectors expressed in the new coordinates 
are still at right angles to one another and still of unit length. 


6.2, Linear Vector Functions 


If a correspondence exists between two sets of vectors V and W 
such that for every vector V there exists a unique vector W, then W 
is said to be a (vector) function of the (vector) variable V. 


W=f(V) . A ; . (6.10) 
When, in addition, the condition 
SOV, + yVo) = xf(Vi) + yf.) . —. (6.11) 


is satisfied for all values of x and y, the function is termed /inear. 


Note. The relationship defined by eqn. (6.11) is also called a linear mapping of 
V-space onto (or into) W-space. An alternative name is homogeneous affinity, 
where the word “homogeneous” refers to the fact that a nullvector is mapped into 
a nullvector. Wis termed the image of V, and V the pre-image of W. Note that 
V and W need not be of equal dimensions. 
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Because matrix multiplication is distributive with respect to 
matrix addition, we see that 


A(xV, + yV.) = xAV, + yAV, - (6.12) 
and we can now formulate a theorem. 
Theorem 24. An equation of the form 
W=AV - (6.13) 


represents a linear vector function. 


Theorem 25. Conversely, any linear vector function can be 
written as a matrix equation of the type given in Theorem 24. 

Proof. Let V;,. . ., V,, span n-dimensional vector space and let 
the V-vectors transform as follows: V, into W,. 


Further, suppose A to be the required functional matrix. Then 
the above n relationship may be written in one equation as 


(W,W,. . .W,) = A(V,V_.. . V,) . (6.14) 


Since the vectors V; are linearly independent, this equation has 
a unique solution, 
A=(WiW,...W,)(VV,...V)J> . 


which proves the theorem. 


It is significant that the proof does not require the W, to be 
independent, nor need A be square. 


. 6.15) 


Exercise. Determine the functional matrix A which transforms (1, 1) into 
(3, 2), and (0, 1) into (1, 1). 
Employing eqn. (6.14), we have 


2at=A{i S} 
Ce ed 
a=ti i} 


Note. There are two distinct ways of interpreting the linear relationship given 
by W = AV. 
According to the active interpretation the vectors W and V are expressed in 


terms of the same coordinate system, and the application of the transformation 
to. V results in another vector W. 


The passive point of view considers V and W to be one and the same vector 
referred to two different coordinate systems (see Section 6.1). 


Post multiplication by 


yields 


— 


i 
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6.3. Rank of a Linear Vector Function 
Suppose that a linear vector function is given by 


W=aAv . 6.16) 


The rank of A is called the rank of the function. The n unit vectors 
in n-dimensional V-space transform into the n columns vectors of A. 
Of these column vectors r are independent. 

When A is square and det (A) + 0, there exists an inverse function 
A“, and there is a one-to-one correspondence between the vectors 
in V-space and those in W-space. 

With the concept of linear vector function at our disposal, we 
can now find another geometric interpretation of the general solution 
of linear equations written in matrix form (see Section 4.2, p. 35). 

The algebraic problem is 

AX=B - (6.17) 


where the vectors X and B need not be like. Geometrically the 
question can be formulated, Does a vector (or vectors) exist which, 
when applied to the linear vector function represented by matrix A, 
transforms into B? 

As X sweeps through all -space, AX will map out a space S(AX) 
the dimension of which is equal to the rank of A. Unless B belongs 
to S(AX) there will not be a corresponding vector X, and the equa- 
tion will have no solution. 

The different possibilities are set out in Table 6.1. 


Table 6.1 
THE GENERAL SOLUTION OF AX =B 


B does not 
belong to 
S(AX) 


Dimension 


ofX B belongs to S(AX) 


(A) =n r(A) <n 


X=X,+ 
nullspace 


no solution | one unique 


solution 


If A is a square matrix the matrices $(A + A,) and }(A — A) 
are respectively symmetric and anti-symmetric. The identity 


A=HA+A)+A-A) 


shows that a square matrix can always be expressed as the sum of a 
symmetric and an anti-symmetric (skew) matrix. 
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An analogous statement can be made concerning linear vector 
functions that have square functional matrices. 


Exercise. Discuss the vector function with the functional matrix 


1 2 
a={a 4} 
We note immediately that the columns of A are proportional, hence r(A) = 1. 
Applying an arbitrary vector (x, y) to A we find that 


wate i} {ero} -6 + {3} 


Apparently S(AX) is a straight line through the origin in the direction deter- 
mined by the vector (1, 2), and all values of x and y for which x + 2y is a constant 
will correspond to the same vector. 

To find the vector which transforms into (3, 6), we must solve the equation 


1 21 fxl _ f3 
2 4f lS = 16 
By the methods outlined in Section 4.2, p. 35, we get 
ee (of ies 
{ha toh +t 
where the last term is the nullspace of A. 
Fig. 6.1 shows the nullspace of A and also the space S(AX). 


Y4 V-space v, W-space 
nullspace StAX 
of A 
x u 


Fic. 6.1. Nutispace or A AND Space S(AX) 


6.4. Transformation of Functional Matrix 
Let W=AV . r % - (6.18) 


be a linear vector function, and let the coordinates of W and V 
transform as described in Section 6.1, namely 


V'=MV or V=M"\’ 
and W'=MW or W=M-"'W’ 
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Substituting these expression in eqn. (6.18) and pre-multiplying 
by M leads to 
W’ = MAM"V’ = A'V’ 
This enables us to formulate the next theorem. 


Theorem 26. When the vector variables of a linear vector function 
transform as follows: V’ = MV and W’ = MW, the functional 
matrix A will transform according to the formula 


A’ = MAM" . s - (6.19) 


The functional matrix is thus partly covariant and partly con- 
travariant. 


Exercise. Let us transpose the members of eqn. (6.19) in order to decide 
under what conditions symmetry (anti-symmetry) of the functional matrix is an 
invariant property under the transformation M. 

We get 

A’, = M;7A.M, = M;7AM;, : : - (6.20) 
when A is symmetric, from which it can be seen that the property of symmetry is 
invariant when the transformation is orthonormal. The same condition applies 
to the invariance of skewness, as can readily be inferred from the equation. 

It is interesting to note how often orthonormal matrices turn out to be in a 
class by themselves. 


6.5. Definition of a Group—Transformation Groups 


Let a finite or infinite set of elements A, B, C,.. .be given, 
together with a method for combining them. The combination of 
two elements is called their product and is indicated by simple 
juxtaposition. 

The set will constitute a group with respect to the product opera- 
tion if the following four conditions (the group axioms) are met— 

(i) If A and B belong to the set, then AB will also belong to it. 
This is the condition of closure. 
(ii) The product of three or more elements is associative. 
(iii) The set contains a unit element J such that 


Al = A(= IA) 


where A is any element of the set. 
(iv) For every element A of the set there exists an inverse element 
A™ belonging to the set such that 
AA = I(= AA) 


If, in addition, AB = BA, where A and B are any elements, the 
group is said to be commutative (or Abelian). 
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A group in which all the elements can be derived from one of 
them by repetition of the product operation, is termed cyclic. 
Cyclic groups are always Abelian. 

If all the elements of a group H are also elements of a group G, 
then H is a subgroup of G. 

In this book we shall only consider groups whose elements are 
matrices with matrix multiplication as the law of combination. 
Therefore, since matrix multiplication is generally associative, we 
need not investigate condition (ii) when verifying that a set of matrices 
forms a group. 

Two groups G (with elements A, B, C,. . .) and G’ (with elements 
A’, B’, C’,. . .) are isomorphic if a one-to-one correspondence can 
be found between their elements 4<> A’, B<> B’,. . . such that 
the identities AB = C and A’B’ =C’ imply one another. Iso- 
morphic groups are structurally identical. 

Exercise 1. From Section 5.3, p. 53, it is clear that all n-by-n orthonormal 
matrices form an infinite group with respect to matrix multiplication: the product 


of two orthonormal matrices is orthonormal, the unit matrix is orthonormal and 
every orthonormal matrix has an inverse (its transpose) which also is orthonormal. 


Exercise 2. An example of a finite group comprising four elements is the 
rotation group 


10 =1 0 i Ce | 
1= {5 iy? -={ 0 a =f} ah sah (ea 4) 
This group is cyclic since all its elements can be written as powers of J w=, 
= -1, FB = —J,and f=1. 

The rotation group is isomorphic with the group consisting of the numbers 
+1, j, —1, and —/ with ordinary multiplication of complex numbers as group 
operation. 

Exercise 3. The following sets of matrices form groups— 

(i) All n-by-n matrices with determinants + 0. 

(ii) All n-by-n matrices with determinants = +1. 

(iii) All n-by-n matrices with determinants = +1. 

Set (iii) is a subgroup of set (ii), which in turn is a subgroup of set (i). The 

‘oup of orthonormal matrices is a subgroup of set (ii). 

The set of all n-by-n matrices with determinants = —1 does not form a group; 
for one thing, the set does not include the identity matrix, and secondly, the 
condition of closure is not satisfied (compare Theorem 15, p. 26). 


An extremely useful property of the group concept is that it 
enables us to classify transformations. As we shall see in Chapter 12, 
groups of transformations and invariance with respect to such groups 
play an essential part in the definition of a tensor. 

In order to relate the two ideas, transformation and group, we 
shall have to decide what the elements of the group are to be and 
how to define the group operation. 


i 
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A linear transformation is uniquely determined by its matrix 
(see Theorems 24 and 25, p. 62). It would therefore seem natural 
to define the elements of the transformation group to be the trans- 
formation matrices. 

As the group operation we shall choose the consecutive application 
of two transformations. It is easy to prove that this operation is 
performed algebraically by multiplying the corresponding trans- 
formation matrices. Let us apply a linear transformation to the 
axes of a coordinate system in such a way that the coordinates of a 
vector V transform according to the formula given in Section 6.1— 


Vi MVo fo) soe) ae RD 


Further, let us apply another transformation to the new axes, 
thus taking V’ into V” as follows— 


Vim. . : i - (6.22) 
Substituting eqn. (6.21) in eqn. (6.22), we find that 
v"=NMV . 5 5 « (6.23) 


Thus the composition of the two transformations M and N (i.e. 
the transformation taking V directly into V”) is represented by the 
transformation matrix NM. 

Having now chosen the group elements and decided upon a 
group operation, we still have to demonstrate that the four group 
axioms are satisfied. 

The condition of closure is obviously complied with: the com- 
bination of two linear transformations is a linear transformation 
whose matrix is the product of those of the component transforma- 
tions. 

Associativity is guaranteed by virtue of the general associativity 
of matrix multiplication. 

The unit element of a transformation group (corresponding to the 
act of “doing nothing”) is the identity transformation in which each 
coordinate axis transforms into itself. It is represented by the unit 
matrix. 

Finally, to comprise a group, each element must possess a unique 
inverse. Hence, only one-to-one transformations, which are always 
represented by square matrices with non-zero determinants, can be 
the elements of a transformation group. 


6.6. Eigenyectors and Eigenvalues 


When a vector function A is applied to a vector V, the result is a 
vector AV which generally differs from V both in magnitude and 
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direction. The question naturally arises, Are there vectors which, 
when operated upon by the functional matrix A, do not change 
their direction? 
Algebraically stated, 
AX=A1X . . ; - (6.24) 


A solution to eqn. (6.24) is called an eigenvector (characteristic 
vector) of the linear vector function A; and the corresponding A, 
an eigenvalue (latent root, characteristic value). From the point of 
view of an eigenvector, the vector function is equivalent to a simple 
scalar multiplier A. 

We shall see later that eigenvectors are fundamentally important 
in many fields of algebra, geometry, applied mathematics and 
mathematical engineering. Problems of stability in complicated 
interconnected systems, for instance, can often be reduced to eigen- 
value problems. 

To solve eqn. (6.24) we rearrange it as follows— 

(A—ADX =0 ; : - (6.25) 
From the discussion of nullspaces in Section 4.3, p. 39, we know 
that this equation has a non-trivial solution only when its deter- 
minant vanishes. 

In expanded form the determinant det (A — AI) = det (R(A)) is 
an nth-degree polynomial in A (the reduction polynomial) which may 
have up to 7 real roots. 

Assuming 4, to be a real root of the reduction polynomial (i.e. 
an eigenvalue of A), we determine the associated eigenvector from 
eqn. (6.25) by substituting A, for A. 

If V, is an eigenvector of a given vector function A, then kV, 
is also an eigenvector of the function because 


A(KV,) = kAV, = kA,V, =A(kV,)) . - (6.26) 
This follows from the linearity of the function. 


Let V, and V, be two non-collinear eigenvectors with the same 
eigenvalue 2. Then 


ACK Vy + kgVo) = kyAVy + keAVe = A(k,Vy + kyVe) (6.27) 
Hence, we have proved the next theorem. 


Theorem 27. Any linear combination of two or more eigenvectors 
with the same eigenvalue is itself an eigenvector. 


In view of this theorem it would be more logical to speak of an 
eigendirection or an eigenspace in connexion with a given eigenvalue. 
The rank of such an eigenspace is equal to the multiplicity of the 


ous: Ps 
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associated eigenvalue (and also equal to the nullity of the corres- 
ponding reduction matrix R(A)). , 

Suppose V, and V, are two eigenvectors of a linear vector function 
with symmetrical functional matrix, and let 2, and , be the corres- 
ponding non-equal eigenvalues. 

We now have 

AV, =A, . > ; - (6.28) 

and AV, =A4V, . 6 A - (6.29) 


Pre-multiplying these two equations by V,, and V,, respectively, 
we find that 


Vy,AV, = 1,VoVy ; ° - (6.30) 

and Vi AV, = AV Vo : : - (6.31) 
By transposing both members of eqn. (6.30), we have 

Vy AVe = VypAVe = AViVe C + (6.32) 


This process does not alter the equations, which are merely scalar 
identities. Therefore, since the left-hand members of eqns. (6.31) 
and (6.32) are identical, the right-hand members must be so too. 
Thus 1 
AVisVa = Ah uVs 5 : . (6.33) 
and because A, + 4,, we must needs conclude that V,,V. = 0. 
In Cartesian coordinates, therefore, we can formulate Theorem 28. 


Theorem 28. Eigenvectors of a symmetric linear vector function 
corresponding to different eigenvalues are orthogonal (i.e. their 
scalar product is zero). 


Exercise 1. To find the eigenvalues and eigenvectors of the function 


2 -2 1 
A=4-1 3 
2 —4 3 


we look for the roots in the reduction polynomial 


4 2-42 -2 A 1 | 
A—AI| = |R@| =|} -1 E ae a? 
|A At = [ROD| | Ba pdatiot, 


= —7? + 87? —13A+6=0 
They are A, = 6 and A, = Ay = 1. 


To determine the corresponding eigenvectors we must solve eqn. (6.25): 
(A —ADX = 0. For A = 6 we have 


=—4 .—2 2 Gx 0 
{=i =a -1| Gh = fal Sterne tw Mes 
Qed —3)-(z 0 


Tot ee ee 
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A=6isa single root; hence the nullity of the reduction matrix is 1 and its rank 
is 2(=3 —1). The solutions of eqn. (6.34) will occupy a 1-space (the eigen- 
direction). Hence, by means of the technique developed in Section 4.3, we get 


1 
V,=1.4-1 
2 
As a check we compute 


2 oe ad t 6r 
AV,=3-1 3 —1$4-1} =3-6F 
2 =a es} Po: 12¢ 


which proves our calculations to be correct. 
In the case of the double root 2 = 1, we must solve the equation 


ee eo 


We now have r(A — I) = 1 (which is clear from the fact that all the columns 
of A —I are proportional). The eigenspace is 2-dimensional and determined 
by the equation 

x—2y+z=0 

Any vector from this space is an eigenvector with the eigenvalue 1. We select 

(arbitrarily) the two orthogonal (and therefore independent) vectors 


1 =I 
¥,=41}> and V;=4 0 
1 1 


The reader should test that any linear combination of V, and V; is an eigenvector 
with eigenvalue 1. 


Exercise 2. Determine the eigenvalues and eigenvectors of the symmetric 
vector function 


The reduction polynomial is 
|R@)| = —23 + 187? — 994 + 162 =0 
which has three distinct roots, 3, 6, and 9. 
The corresponding eigenvectors are determined in the manner described in 
Exercise 1, and are found to be 


off e(j en 


In accordance with Theorem 28, the three eigenvectors are mutually orthogonal. 


Exercise 3, A very special example of a vector function is the indentity 
function represented by a unit matrix. In this case the reduction polynomial 
is simply 

(a —A" =0 
which has an n-fold root 2 = 1. The reduction matrix A — AI degenerates into 
an n-by-n nullmatrix (the nullity of which is ), and any vector is an eigenvector. 
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Exercise 4. Discuss the 3-dimensional skew (anti-symmetric) vector function 


O° ‘¢ 76 
A=4;-c 0 a4 
6 -a 0 


The rank of A is 2 and the reduction polynomial is 


—-A  c¢ -b 
dea —an = {5 —) ebm td ++# +e)=0 
b -a -) 


The function has one real eigenvalue 4 =0 (this is obvious from the fact that 
det (A) = 0), and the corresponding eigenvector is found by solving the equation 


0 c¢ —b) {x 0+ cy —bz 0 
—c 0 aryyp=4—ex+ O+az->=40 . (6.35) 
by = 2. » O)\ lz bx —ay+ 0 0 


which yields 


We note that V,A = 0, (this follows because V is an eigenvector with zero 
eigenvalue, and A is skew). Hence, V and AX, where X is any vector, will 


be orthogonal— 
V{AX) = (VA)X = 0,.X = 0 


Also, X and AX are always orthogonal, since X,AX vanishes identically 
(we shall encounter this property of skew matrices in connexion with quadratic 
forms in Section 7.1, where a proof is given). 

The reader who is familiar with 3-dimensional vector algebra will recognize 
the middle member of eqn. (6.35) as the expression for the cross-product of the 
vector X and a vector with coordinates (a, 6, c). 


As a further exercise the reader might investigate how many of 
the above-mentioned properties of skew vector functions in 3-space 
carry over into the n-dimensional case. 


Exercise 5. In this exercise we shall discuss vector functions with ortho- 
normal matrices in Cartesian coordinate systems. Bearing in mind our previous 
experience with matrices of this type, it would seem reasonable to expect that 
such functions should exhibit rather special characteristics; this turns out to be 
the case. 

(i) The magnitude of a vector is invariant to the application of an orthonormal 
vector function— 

(AV) (AV) = VAAV = VdV = VV 


ice. the scalar product of a vector by itself is invariant. 

(ii) Similarly the scalar product of any two vectors V, and Vj is also invariant 
when subjected to an orthonormal transformation. 

From these properties we can infer that the angle between two vectors is equal 
to the angle between their images: the angle between two vectors is also invariant 
to an orthonormal transformation. 
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(iii) An n-by-7 orthonormal functional matrix (where » is odd) with a deter- 
minant equal to +1 has an eigenvalue A = +1. This is equivalent to proving 
that 

det (A—T=0 : é = « (6.36) 


Making use of eqn. (3.6), p. 24, and Theorem 15, p. 26, we can derive the 
expression 
det (A — I) = det (A,) det (A — I) = det (A(A — I) = det — A) 
= det (—(A — D,) = (—1)" det (A — I) = — det (A —1) 
and comparing the first and last terms in this long chain of identities, it is clear 
that eqn. (6.36) is valid. 

By an exactly analogous train of reasoning we can demonstrate that when 
det (A) = —1 the functional matrix has the eigenvalue —1. 

For the special case n = 3 an orthonormal function represents a rigid rotation 
in space. This immediately explains why the magnitude of a vector and the 
angle between two vectors remain unaltered. The eigendirection corresponding 
to the eigenvalue A = 1 is the axis of rotation. When the functional determinant 
is —1, the rotation is coupled with a reflexion. 

It is instructive to note how the proof of (iii) breaks down for even dimensions 
by leading us to the sterile identity of the reduction determinant with itself. 


6.7. Invariance of Reduction Polynomial 


It has been shown in Section 6.4 that the functional matrix of a 
linear function transforms according to the formula 


- (6.37) 
when the vectors transform as follows 
Vv’ = MV 
In the new coordinate system the reduction matrix is 
R‘(4) = A’ — AL = MAM" — 71 = MAM“ — AMIM-1 
= M(A — 2DM* = MR(J)M . (6.38) 
Thus, the reduction matrix transforms in exactly the same way as 
the functional matrix. By using Theorem 15, p. 26, we find that 
det (R’(A)) = det M det (R(A)) det (M™) 
det M det (R(A))/det (M) = det (R(A)). 
Theorem 29. The reduction polynomial det (R(A)), belonging to 
a vector function with a square functional matrix, is invariant to 


any non-singular linear coordinate transformation. 
In expanded form the reduction polynomial will be 


det (R(A)) = (—1)"4" +c, A714... 4+ G4 +e 


._— - 
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where the c’s are scalar constants and n is the order of the deter- 
minant. Since the polynomial is invariant to all invertible linear 
transformations for all values of 2, each of the constants ¢ must be 
invariant. 

Two of these scalar invariants are of particular interest— 


(® co, the constant term of the polynomial, is equal to det (A). 
When cy = 0, the function is singular and 2 = 0 is an eigenvalue. 
All the corresponding eigenvectors fill the nullspace of A. 

If the nullity of A is p >1, the constants up to and including 
cy, vanish, and 4 = 0 is a p-fold solution of the polynomial. 

(ii) c,_1, the coefficients of 2"-1, represents the sum of the elements 
along the main diagonal of the functional matrix multiplied by the 
factor (— 1)": 

Cua = (— 1)" Gy + ag +. . + nn) 


Some authors call it the trace of the matrix A; others use the 
German word Spur. The process of forming the trace of a square 
matrix is called contraction. 


Exercise. Take the function discussed in Exercise 2, Section 6.6, whose 
matrix was 
7 —2 0 
A=4-2 6 -—2 
0 =2 5 
and apply transformation 
01-2 
M= { 0 1 
: ia | 0 


to the coordinates. The inverse of M is readily calculated to be 


1 2 -1 
M*=j;-1 -—2 2 
-1 —I 1 
and the transformed functional matrix is 
ye —12 10 
A’ = MAM = {6 iv —10 
Co as 
We can now compute the reduction polynomial 
det (R(A)) = —7? + 187 — 990 + 162 


which is identical with the expression derived in Exercise 2, Section 6.6. 
Note that the trace of both A and A’ is +18, and that det (A) = det (A’) = 162. 
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To conclude this section we shall prove a theorem concerning 
symmetric functional matrices. 


Theorem 30. A linear vector function with a symmetric n-by-n 
functional matrix has n real eigenvalues. 

Proof. Let A be symmetric. If we employ for a moment the field 
of complex numbers, the reduction polynomial will always have 
n roots. Suppose now that 2 is a complex root of the equation 
det (A — AI) = 0, and hence an eigenvalue of the vector function A. 
Since the coefficients of the reduction polynomial are real, the con- 
jugate 2, of 2 must also be an eigenvalue of A. 

If V is an eigenvector corresponding to , then V, is an eigenvector 
corresponding to /,, and the coordinates of V, are the conjugates 
of the corresponding coordinates of V. Thus we have 


AV=1V 
and AV, =2.V, 
Pre-multiplying these equations by V,, and V, respectively and 


rearranging, we get 
4 = V.AV/(V iV) 


and A, = VAVI(V.V,) 


- (6.39) 
- (6.40) 
By transposing the right-hand member of the scalar eqn. (6.40) 


it is seen to be identical with the right-hand member of eqn. (6.39). 
Thus / = 4,, and therefore 2 must be real. 


6.8. Reduction of Functional Matrix to Diagonal Form 


We shall now set ourselves the problem of finding a coordinate 
transformation M which will reduce the matrix of a vector function 
to a diagonal matrix 


bs Os mee HO 
(ge ag sagt 
Beye mec 
OO koe 


This means that M must transform A into B as follows— 
MAM = 
Pre-multiplying by M~, we get 
AM = MB 


7, 
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The column vector V; of the matrix M~ must satisfy the equation 
0 


AV, = M“B, = M4, | = 4,V, 
t 


. (6.41) 
0 
where B, is the ith column of matrix B. 

Eqn. (6.41) clearly shows (see eqn. (6.24)) that the columns of 
Mare the eigenvectors of the functional matrix A, and the diagonal 
elements of B are the corresponding eigenvalues. 

We can now formulate Theorem 31. 


Theorem 31. Any n-by-n functional matrix with n real eigenvalues 


Ay... +4, can be reduced to the diagonal form (we shall coin a 
verb to diagonalize). 
Ay Oar 0 
Oe AS ee 3 O 
ges i Fiala ea 
OO es po Ay, 


by a transformation M, where the column vectors V,; of M-! are 
the eigenvectors belonging to the eigenvalues ,. 


Theorem 32. With the help of Theorem 30 we can state that a 
symmetric vector function can always be diagonalized. 


Note. The reason for calling the expanded determinant 
det (R(A)) = det (A — AD) 
the reduction polynomial ought now to be apparent. 


Exercise 1. Diagonalize the functional matrix 


7-2 0 
A=4-2 6 —2 
0 -2 5 
of Exercise 2, Section 6.6. 


The eigenvalues of this matrix are 3, 6 and 9, and the eigenvectors are 


valent 


respectively. Joined together, they form the inverse of the required transformation 


matrix, 
cag hit 
MM =42 1 =2 
Dire B=) a mth j 


Se ae 
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from which we calculate 
mit 2 2 
5 zs 1 —2 
2-2 #1 


The observant reader will have noted that M and M~' are proportional; this 
is because M- is orthogonal and symmetric, and its column vectors are of 


equal length. 
Applying the transformation to the functional matrix, we find 
A’ = MAM" 


pit. 2.7 2) af Beh aale Moyes S22 
S542 1'=2¢4=2 6 —2742) 2 —2 
2-2 1Jl 0-2 5) l2 -2 1 
300 
=10 6 0 

009 


In practice it is quite unnecessary to compute MAM“", as we have done here, 
since the diagonalized form matrix is obtained as soon as the eigenvalues have 
been determined. In many cases there is no need even to calculate M and M~. 


Exercise 2. In Exercise 1, Section, 6.6, the Functional matrix 


at 
Aidt ge 
2 4 3) 


was shown to have the eigenvalues 6, 1 and 1. The single root yielded the eigen- 


vector 
1 
Vedat 
2 


and from the 2-dimensional eigenspace corresponding to the double eigenvalue 1, 


the vectors 
n =i 
Vz,=41+ and V3= 0 
af 
were chosen. 
In order to demonstrate that any set of independent eigenvectors selected from 
the eigenspace of a multiple eigenvalue will perform the diagonalization of A, 


we shall use the vectors V, and V3 = V, +¢V3 to build the transformation 
matrix M7. 


? Ani St 
Thus M*t=,-1 1 1 
2d Det 


from which we compute 
1 t =2t t 
M=—.43+t -—1+3t -—2+t 
#3 1 2 


The presence of the parameter ¢ in the denominator is a warning that ¢ cannot 
be allowed to be zero; for when t = 0, V, and V3 are no longer independent. 
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The transformation M takes A into 


600 
A’=MAM*=;0 1 0 
001 
all the #’s cancelling out in the process. 


Exercise 3. Reduce to diagonal form the matrix 


01 
anti of 
The reduction polynomial is 
det (R(Z)) = | me re | =2-—1=0 
Hence, 2; = +1 and A, = —1, and the corresponding eigenvectors are readily 


found to be 
afi amt ne (f 
respectively. Thus 


min{t 1} aame.{t I} 


and A transforms into 


: 1 0 
ead ain tait ree 
Ce £0 
=jo _ 
The functional matrix A is symmetric, and the two eigenvalues are not equal. 
This means (see Theorem 28, p. 69) that the column vectors of M7 are ortho- 


gonal, and we can refine our solution by making M~ orthonormal. The modified 
transformation matrix is 
na {iv2 _iv3 


v2 —}v2 
N-t is also symmetric, and hence 
N=(N); = (NJ? =N 


Note. Didactically, problems in 2-space are well suited to give the reader a 
clear understanding of the geometric meaning of his algebraic manipulations. 
Assuming that the vector function of Exercise 3 is referred to Cartesian coordin- 
ates, it is a simple matter to visualize how it operates. 

The function A reflects the whole xy-plane about the line y = x. This line is 
therefore an eigendirection with eigenvalue +1. Any line perpendicular to 
y = x remains invariant, except for the fact that it is swung round to point the 
other way; hence the eigenvalue of the eigendirection y = —x is equal to —1. 
Applying the orthonormal transformation N to the function merely rotates the 
axes to lie along the two orthogonal eigendirections. 


6.9. The Cayley-Hamilton Theorem 


As a necessary preliminary to the proof of the Cayley-Hamilton 
theorem, we shall investigate how the powers of a functional matrix 
are affected by coordinate transformations. 
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Raising both members of the transformation eqn. (6.19) to the 
power p, we get 


(A’ = (MAM*)? = (MAM~)(MAM")). . . (MAM~) 
= -IMAM-". . .MAM-+ 
= MAIAT. . . IAM = MA?M* = M(A”)M“ (6.42) 
which shows that A” transforms in exactly the same way as A. 


Substituting A for 2 and I (= A®) for 2° in the reduction poly- 
nomial, we obtain a matrix reduction polynomial which we shall 
denote by R(A), and we can now state the Cayley-Hamilton 
theorem. 


Theorem 33 (Cayley-Hamilton Theorem). The matrix reduction 
polynomial of a functional matrix vanishes identically. This theorem 
is often paraphrased to read: A functional matrix satisfies its own 
reduction polynomial. 

To prove the theorem, let A be an -by-n functional matrix with 
n real eigenvalues, and let M be a diagonalizing transformation 
such that 

MAM = A, 


where A, is a diagonal matrix whose ” non-zero elements are the n 
eigenvalues. Finally, let R(A) denote the matrix reduction poly- 
nomial corresponding to the vector function A. 

Applying transformation M to R(A), we derive 


MR(A)M“ = M[(—1)"A" + ¢, ;A"2 +... + A + oI]MO 
= (—1)"MA"M+ + ¢, ;MA"IM+ +... 
+ ¢MAM~ + coMIM+ 
= (—1)"A + ce gAG +... + Ag+ ol . (6.43) 
All the off-diagonal elements of this matrix equation are zero, 
so we need only study the elements along the main diagonal. Re- 
calling that, if A, is a diagonal matrix with element @,, in position 
ii, then A? will also be diagonal with a?, in position ii, it is clear 
that the element in row i and column / of the last member of eqn. 
(6.43) is 
(—1)". 42 + cy AP tH oA GA + eg . (6.44) 
and, since 4, is a root of the reduction polynomial, this expression 


is equal to zero. 
' We conclude, therefore, that 


MR(A)M-! = 0 
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from which we derive, by pre-multiplication by M™ and _post- 
multiplication by M, that 

R(A) =0 
thus proving the theorem. 

The theorem is still valid when we weaken the condition that A 
shall have 7 real eigenvalues so as to permit the reduction polynomial 
to have complex roots. 

With the aid of complex numbers we can pursue the same train 
of reasoning to arrive at the same result. 


Exercise. Test the Cayley-Hamilton theorem in connexion with the vector 
function 
0 
asin oa) 


The reduction polynomial is det R(A) = 2? + 1, which has no real roots (the 
function corresponds to a 90° anti-clockwise rotation of the xy-plane about the 
origin, an operation which leaves no vector unchanged). 

Substituting in the polynomial, 


0 =1 ro 10 
vtr={? ot {i ot + {5 2 


“(4 $8 9)-(88 


PROBLEMS 


6.1. Determine the matrix of a linear vector function which maps (1, 1) into 
(2, 0, 1), and (0, 1) into (1, —1, 0). Is this linear function one-to-one? Can it 
be inverted? 


6.2. Determine the functional matrices of the following linear vector functions— 


(1, 0, 0) into (0, —1, | 
(1, 0, 1) into (1, 0, 0) 
(0, 1, —1) into @, 1, 2) 


(0, 0, 1) into (1, 1, 0) } 


@ 


(1, 1, 1) into (2, 2, 0) 
(1, 1, 0) into (1, 3, —2) 


- (ii) 


(1, 0) into (, 1) a 
(0, 1) into (—1, 0) (paca de acs NO, 


Discuss the rank of these functions and calculate the inverse functional matrices 


if possible. 


6.3. In Exercise 5, Section 6.6, it was stated that an orthonormal matrix A 
with det (A) = —1 always has an eigenvalue of —1. Prove this contention and 
discuss whether it is necessary that the dimension of A be odd. 


6.4. Let A and B be two like, square matrices. Prove that AB and BA have 
the same eigenvalues. 
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6.5. Apply the Cayley-Hamilton theorem to the skew matrix 


0 e —b 
A=j,-c 0 a 
6b -a 0 


6.6. Give a general discussion of the contents of Exercise 3, Section 3.7. 
Hint. Introduce the ranks of A and B and decompose the post-factor into column 
vectors. 

6.7. Prove that the set of all n-by-2 matrices which commute forms a group. 
How is this group related to the groups mentioned in Exercise 3, Section 6.5? 

6.8. Prove that, if the square matrix A has eigenvalues 2, (+ 0), then A-* 
will have the eigenvalues 1/7,;. 

6.9. Verify that matrix A of Problem 5.5, considered as a functional matrix, 
rotates the whole of 3-space rigidly about the z-axis in such a way that the positive 
direction of the y-axis is carried into the positive direction of the x-axis. Show 
also that matrix B rotates 3-space about the y-axis in such a way that the positive 
direction of the x-axis falls along the positive direction of the z-axis. 

Perform these rotations with (say) a matchbox so as to demonstrate that 


AAT=A7A=I, ‘ . < - fi) 
AB#BA. . ee Eher Aa) 
(AB)? BAD ele Mie wip 
6.10, Express the linear function 
x =xt+y 
5 ed 


in matrix form as X = AY and determine its eigenspace. 

6.11. From classical vector analysis it is known that the area of the parallelo- 
gram determined by two vectors is equal to the product of their magnitudes and 
the sine of the angle between them. Prove that, if the area thus determined by 
the vectors V and W is a, then 

a = V,VW,W — V,WVW = (det (VW))* 

Hint. Use the fact that 

VW = VW .cos (V,W) 
and sin? (V,W) = 1 — cos* (V,W) 

6.12. Let a 2-by-2 functional matrix A =(A,A,) be given. The two 2- 
dimensional unit vectors U, and U, define a unit paper and transform as follows: 
U, into A, and U, into A,: (A,A,)(U,U,) = A,A,). 

Use this result to prove that the unit square is mapped into a parallelogram 
with an area equal to det (A). Show that (because of the linearity of the function) 
any area will be mapped into an area det (A) times larger. 

6.13. Employ the result of Problem 6.12 to show that the function of Problem 
6.10 leaves areas invariant. 


6.14. Discuss and compare the linear vector functions 
i =2 
A= {i of and A, = 3A, 


and give a geometric interpretation of the equation det (KA) = k" det (A) (n = 2) 
(see eqn. (3.6), p. 24). 


Ree 
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6.15. Generalize the result of Problem 6.12 to three dimensions. 
6.16. Show by direct matrix multiplication that matrices of the form 
cosu —sin u 
sinu cosu 
form a group under matrix multiplication. Discuss under what conditions a 
2-by-2 matrix such as the one given above can generate a finite (cyclic and 
Abelian) group. 
6.17. Prove that the set of matrices of the type 
Qo 
0:4 
where Q is any r-by-r orthonormal matrix, and I is the (n — r)-by-(n — r) unit 
matrix, form a group with respect to matrix multiplication, and show that such 
a group is a subgroup of the group of n-by-n orthonormal matrices. 
6.18. Resolve the square matrix 


Loe See 
into its symmetric and anti-symmetric components. 


' CHAPTER 7 
Bilinear and Quadratic Forms 


7.1. Definition of a Form 
Any combination of matrices and vector variables yielding a scalar 
is termed a form. In this book we shall be particularly concerned 
with bilinear and quadratic forms that occur so often in various 
disguises in geometry and applied mathematics in connexion with 
scalar quantities such as distance, angle, dissipated and stored 
energy, etc. 
An expression 
T=VAW . : : = (7) 


where A is square and V and W are equi-dimensional variable 
vectors, is called a bilinear form. The adjective “bilinear” refers to 
the fact that eqn. (7.1) satisfies the linearity requirements (see 
Section 6.2, p. 61) for both vectors variables. For example, 


(kV, + keVa), AW = Vy, AW + kV, AW 
and similarly for the variable W. 

If T is invariant to an interchange of V and W, the form is said 
to be symmetric. This implies that the form matrix A is symmetric, 
since from the identity 

V.AW = WAV 
we can conclude that A, = A. 

In the special case where V and W are one and the same vector. 

the form is called quadratic because 
T=V,AV 
is a second-degree polynomial in the coordinates of V. 

Only the symmetric component of A need be considered (see 
Section 6.3, p. 63), since the quadratic form associated with a 
skew matrix vanishes identically, for when A is skew A, = —A, and 

V,AV =(V,AV), (because the form is a scalar) 
VAY, 
—V,AV 
which proves that V,AV = 0. 
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7.2. Transformation of the Form Matrix 


When the coordinates of V and W are subject to a transformation 
M (V' = MV, W’ = MW), the form matrix A will also transform— 


T=V,AW 
= (M"V’), AMP) 
= Vi(M;"AM~*)W’ 
= ViA'wW' 
and we can formulate the next theorem. 


Theorem 34. When the transformation V’ = MV(W’ = MW) is 
applied to the coordinates of a bilinear or quadratic form, the form 
matrix A transforms according to the expression 

A’ =M,;7AM"+ 

Comparing this with eqns. (6.3) and (6.5), and bearing in mind 
that the coordinate axes are covariant by convention, the form 
matrix is seen to be doubly covariant. 

By referring back to Exercise 1, Section 6.1, we note that the 
metric of a space is in fact a form matrix. 

Also, if we consider the orthonormal group of transformations, 
the transformation formula becomes 

y A’ = MAM"! 
which is identical with that of Theorem 26, p. 65. 

It has been pointed out that the form matrix A of a quadratic 
form is symmetric. Hence, by virtue of Theorem 30, p. 74, A has 
n real eigenvalues. Furthermore, since the transformations given in 
Theorems 26 and 34 are identical for orthonormal transformations, 
we can make use of Theorem 32, p. 75, to formulate Theorem 35. 


Theorem 35. The form matrix of a quadratic form can always be 
reduced to a diagonal matrix by means of an orthonormal coordinate 
transformation. 

After diagonalization the form matrix will be Ay and the quadratic 
form will be 

T = V,AWV = Aw} + Ae +... + A,0,2 


where 4;,. . ., 4, are the eigenvalues of A (= the diagonal elements 
of A,). 

The number (p) of positive eigenvalues is termed the index of T. 
If we denote the rank of A by r (= r(A)), then — r of the eigenvalues 
are zero, and r — p are negative. 


——— a 
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Quadratic forms are classified as indicated in Table 7.1. 


Table 7.1 
CLASSIFICATION OF QUADRATIC FORMS 


Pp r Class 

n n positive definite 
r r<n| positive 

0 n negative definite 
0 r<n|_ negative 
<r |r<n_|_ indefinite 


We note that positive and negative definite forms are equal to 
zero when, and only when, V = 0. For any other value of the vector 
variable the positive definite forms will always be positive and the 
negative definite forms negative. 


Exercise. Transposing both members of the equation of Theorem 34, we get 
(A’), = (M;7AM™), = M-1A.M,*? = MAM" = A’ 
Hence the symmetry of the form matrix is an invariant property under any non- 


singular coordinate transformation. Compare this result with that of the 
Exercise in Section 6.4. 


7.3. Simultaneous Diagonalization of Two Form Matrices 


Having diagonalized the form matrix A by means of an ortho- 
normal transformation N, we can go a step further by applying a 
diagonal transformation M with the element +/|A,| in position ii 
on the main diagonal. The corresponding element of M-? (which 
when M is a diagonal matrix is equal to M,“) is 14/|4,|.. When an 
eigenvalue is zero any non-zero number can be used in the corres- 
ponding place in M; it will subsequently cancel out when the trans- 
formation is applied to A,. 

Transforming A; by M results in a normalized diagonal matrix— 

Aum = M;"A,M> 
= M;(N;7AN 4M 
= (MN);*A(MN)* 
with elements +1, —1 and 0 along the main diagonal according to 
whether the corresponding eigenvalues are positive, negative or 
zero. It should be carefully noted that the normalizing process 
hinges on the double covariance of the form matrix. 

If A is positive (negative) definite, its normalized diagonal form 

will be equal to I (—I), and it will therefore be invariant to any 
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subsequent orthonormal transformation K, as is immediately 
apparent from the expression 


K(4ADK, = +KK, = +1 


Exercise 1. In the general case, the normalized diagonal form matrix can 


be written 
I oo 
Ag=34O -I O 
By O70: 
This form is invariant (as can be readily verified) to orthonormal transformations 
of the type 
POO 
K= {9 Qo 
OOR 


where the square submatrices P, Q and R are orthonormal, and the partitioning 
of K is such that the product KA,,K, is defined. 


Suppose now that two quadratic forms 7, and T, with form matrices 
A and B, respectively, are given. Further, let us assume that A is 
positive (negative) definite. We have shown that it is always possible 
to diagonalize A by means of an orthonormal transformation N, and 
then to normalize A, by applying a diagonal transformation M. 
The resultant matrix is 


Aw, = (MN)A(MN)* = I(—1) 


which, as we have seen, is invariant to any subsequent application 
of an orthonormal transformation. 
Applying the transformation MN to the form B gives us 


B’ = (MN)*B(MN)* 
B’ being symmetric can be reduced to diagonal form by means of 


an orthonormal transformation K (which leaves A,, invariant). 
Hence, we have proved the next theorem. 


Theorem 36. Two form matrices A and B, where A is positive 
(negative) definite, can be simultaneously reduced to normalized 
diagonal and diagonal form, respectively, by means of a transforma- 
tion KMN, where K and N are orthonormal and M is a diagonal 
matrix. 


From the preceding discussion the procedure for simultaneously 
diagonalizing two matrices A and B is clear. We first determine N 
as described in Section 6.6, p. 67, and then compute the normalizing 
transformation M. After transforming B into B’ by means of the 

4—{T.1046) 
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matrix MN, we calculate the eigenvalues of B’ and the associated 
diagonalizing transformation K. 

There is, however, a short-cut procedure for computing the final 
quadratic form without having to determine N, M or K. 

Let T, and 7, be the quadratic forms associated with A and B, 
respectively. 

The quadratic form 

Tz — kT, = V(B — kA)V 
transforms into 
T, — kT, = W(B, — kAg,)W 
= (4, — wi t+ (4, — wet. +A, — Wwe 
in which equation 
B, — kA,, = (KMN);“(B — kA)(KMN)* 
Hence, det (By — KAz,) = (Ay — D(A, — Kk). . - An — 
= det® (KMN)-* . det (B — kA) 


where det? (KMN)~" is independent of k. 
This means that the determinants 


det (B, — KAg,) = (4, — Kaz — kK). - An — 2) 


and det (B — KA) are proportional nth-degree polynomials in k and 
have, therefore, the same roots k = A,,. . -, Ay. 

To calculate the constants 4,,. . .,4,, we seek the roots of the 
equation det (B — kA) = 0. 

When A is positive (negative) definite A~' exists and the above 
equation has roots which are the eigenvalues of the matrix A“"B. 


Exercise 2. To illustrate the method of simultaneous diagonalization, let 


72 #0 
A= y—2-, 9 6)--—2 
0 2 3 


which we know from Exercise 2, Section 6.6, to be positive definite, and let 


a 0 
B=,1 1 0 
00 —-1 


We find that det (B — kA) = —162k* + 43k? + 17k =0 


whose roots are kK = 0:48, —0-22 and 0. 
T, thus reduces to w? + w? + w3, and 7; to 0-48} — 0-22w3. 
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7.4. Equivalence Relations and Equivalence Classes 

A correspondence or equivalence between the elements a, b, c,. . . 
of a set is said to be an equivalence relation (an R.S.T. relation) if 
the following conditions are satisfied. The correspondence must be— 


(i) Reflexive: any element is equivalent to itself. 
(ii) Symmetric: if a is equivalent to b, then b is equivalent to a. 
(iii) Transitive: if a is equivalent to b, and b is equivalent to c, 
it follows that a is equivalent to c. 


The establishment of an equivalence relation separates the 
members of a set into mutually exclusive subsets called equivalence 
classes. 

Let a, b,, c,. - . belong to class C,, and dg, by, C2, . . ., to class 
C,. It is easy to prove that these two classes are either identical or 
have no element in common. If one element a, (say) of class C, 
is equivalent to an element a, (say) of class C,, the transitive property 
of the relation will cause a, to be equivalent to all the elements of 
C,. Furthermore, the symmetry of the equivalence makes a, equiva- 
lent to a,, and hence transitively to all the elements of class C,. 

Thus, two equivalence classes cannot have an element in common 
without becoming identical, and are therefore mutually exclusive. 

To give an instance of a system of such classes, consider the set 
of all (symmetric) n-by-n form matrices A, B, C,. . .. 

We shall define A to be equivalent to B if there exists a transforma- 
tion belonging to the group G,,, of n-dimensional orthonormal 
transformations, such that 

B=M,7AM" = MAM" . : . (7.2) 

This correspondence between A and B (which is sometimes called 
congruence) is an R.S.T.-relation. 

It is reflexive, since A is equivalent to itself, 

A=IAr* 
where I is the (orthonormal) unit element of the group G,,,. 
It is also symmetric. Pre- and post-multiplication of eqn. (7.2) 
by M“ and M, respectively, yield 
A= M"BM = (M*)B(M")* 
i.e. B is equivalent to A, where M-, according to the fourth group 
axiom, also belongs to G,,,. 
Finally, the correspondence is transitive because the equivalence 


of A and B, 
B=MAM" . ; 3 . (7.3) 
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and the equivalence of B and C, 
C=NBN"_.. A 4 . (7.4) 


implies (by substituting eqn. (7.3) in eqn. (7.4)) that A is equivalent 


to C: 
C = N(MAM~)N“ = (NM)A(NM)** 


where NM is a member of G,,,, since both M and N belong to G,, 
and the group is closed. 

We shall see in Section 8.1 that the above classification of quad- 
ratic forms admits of a very simple geometric interpretation in 2- 
and 3-space. 


PROBLEMS 

7.1. Diagonalize the quadratic forms 
e—2xyty  . : : ; xe OD 
imidey i) a : : oti 247 GD, 


7.2. Write the quadratic form T = x* — 6xy — y® in the form T = X,AX, 
and diagonalize it. 


7.3. Apply the linear transformation 


xx ty’ +27 
beanie fois 
z=x—y’ 


to the quadratic form z* — 2xy by means of the equation of transformation 
given in Theorem 34 and test the result by direct substitution. 


7.4. Reduce the expressions 
z* — 4z — Ixy + 6x — 2y - 2 E = 
x —6x+y? +6y—2xy . 4 : - Gi) 
by means of coordinate translations x = x’ +a, y=y’ + 6, and z=2'+¢, 
so as to eliminate the linear terms. 

7.5. Discuss the conditions for positive definiteness for the quadratic form 
ax* + 2bxy + cy*, and show that the two eigenvalues of the form matrix are 
always real. 

7.6. Test the assertion in the first paragraph of Section 7.3 that the application 
of the transformation M reduces Ay to normalized diagonal form. 

7.7. Prove that the normalized diagonal matrix of a positive form is invariant 
to any orthonormal transformation of the type 

Qo 

ort 
where Q is an r-by-r orthonormal matrix, and I is the (n — r)}-by-(n — r) unit 
matrix. 


| 
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7.8. Let a, b and c be the coefficients of the quadratic form given in Problem 
7.5. Prove by direct calculation that a + c and ac — 6? are invariants under the 
group of 2-by-2 orthonormal transformations. 

7.9. The kinetic energy of a particle, with mass m and moving with velocity 
V, is T = 4mV,V. Show that Tis invariant to any rigid rotation of an orthogonal 
coordinate system. 

7.10. Prove the statement in the last paragraph of Section 7.3 that the roots k; 
of the equation det (B — kA) = 0 are the eigenvalues of A“*B. 

7.11. Show that the relationship between the sets of vectors A and B introduced 
in Section 2.4, p. 10, is an R.S.T.-relation. What do the corresponding equiva- 
lence classes represent geometrically? 


CHAPTER 8 


Application of Matrices to 
Geometry and Mechanics 


8.1. Central Quadric Surfaces 


WE are now equipped to carry out a complete analysis of algebraic 
surfaces (and curves) of the second degree. To save space, however, 
we shall limit ourselves to a brief discussion of central quadric 
surfaces, i.e. surfaces that can be expressed by an equation of the 
type 

ax? + by® + cz* + 2dyz + 2exz + 2fxy=k . (8.1) 


where k is a positive constant. 

The adjective “‘central” refers to the fact that the origin O = 
(0, 0, 0) is the centre of any surface of this type. If P = (Xp, Yo, 29) 
is a point on the surface, then Q = (—x9, —¥o, —2), which is 
symmetric to P with respect to O, will also satisfy eqn. (8.1). PQ is 
termed a diameter of the quadric. 

In this Section we shall consider only Cartesian coordinates and 
orthonormal coordinate transformations (i.e. rigid rotations of the 
coordinate system). 

Eqn. (8.1) is readily generalized to n-space, and can be written 
very concisely as a quadratic form 


Tihs hy a 0, nl cp th een v ASD) 


where A is symmetric and therefore has n real eigenvalues. By virtue 
of Theorem 32, p. 75, it is always possible to diagonalize the form 
matrix, which, in terms of eqn. (8.1), means that all product terms 
vanish, leaving only the squares. 

Thevarious possibilitiesin Euclidean 3-spaceareset outin Table 8.1. 

When one of the eigenvalues is zero, the corresponding surface 
(if it exists) degenerates into an elliptic or hyperbolic cylinder. If 
two eigenvalues vanish, the equation will represent two parallel 
planes perpendicular to one of the coordinate axes. 

In the special case k = 0, we note that, if a point P = (xo, Yo, Zo) 
satisfies the equation 

X,AX =0 
90 
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then any point Q = (tx, typ, #29), where ¢ is any real number, will 
also be a solution. Thus the corresponding surface is a cone. The 
indefinite forms will represent proper elliptic cones, whereas positive- 
definite or negative-definite forms will only represent the origin 
(0, 0, 0). 


Table 8.1 
PROPER QUADRIC SURFACES IN 3-SPACE 


Surface 


Ellipsoid. When two 2’s are equal, a rota- 
tional ellipsoid. When all three /’s are 
equal, a sphere. 


positive definite 


indefinite Hyperboloid with one sheet. When the two 
pos. /’s are equal, a rotational hyperboloid 


(“cooling tower”). 


indefinite Hyperboloid with two sheets. When the two 


neg. A’s are equal, a rotational hyperboloid. 


pos. neg. neg. 


negative definite | The equation represents nothing. 


To return to the case where k > 0, we see that two quadrics with 
identical matrices, but different values of k, are homothetic (i.e. the 
one surface can be derived from the other by multiplication from 
the origin). If (xo, yo, Zo) is a point on the surface corresponding to 
the constant k,, then {+/(ka/k,)}(xo, Yo, Zo) is a point of the surface 
pte gees with k,. This result stems from the bilinearity of quadratic 
‘orms. 

Interpreted geometrically, the classification of form matrices given 
in Section 7.4, p. 87, can readily be visualized. For a constant 
value of k, equivalent matrices correspond to the same quadric 
surface referred to different Cartesian coordinate systems. It is 
obvious, therefore, that the classes must be discrete. 

In 2-space a non-degenerate quadric is either an ellipse (with 
the circle as a special case) or a hyperbola. Degenerate curves are 
two parallel lines or, when k = 0, two intersecting lines through 
the origin. 

Exercise 1. In order to analyse the quadric 

Sx* + 2y* + 22% — 4xy — 4xz — 8yz = 108 
which can be written in matrix form as 


5 —2 =—2) [x 
{x y 2} {3 2 =4| (h = 108 
=2) 4) 2p fe 
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we must first find the roots of the reduction determinant 
det (R(A)) = —/3 + 97? — 108 = —(A + 32 — 6? =0 
The eigenvector corresponding to the eigenvalue —3 is found to be 


1 
V, = 32 
2 
From Theorem 28, p. 69, we know that the eigenvectors of the double eigen- 
value +6 span a 2-space and are orthogonal to V;. They must lie in the plane 
x+2y+2z=0 


As one of them we choose (arbitrarily) 


( 


and as the other we calculate the vector which is perpendicular to both V, and V,; 
this gives us 
—4 
V,=4 1 
1 


_ From these three orthogonal vectors we compute a diagonalizing transforma- 
tion matrix by normalizing the columns of the matrix 


f VV) 
This leads to the matrix 


3 0 42/6 
M= e V2/2 vast 
7B —v2j2 46 


-3 0 0 
A’=4 060 
00 6 


The corresponding quadratic form is 
—3x? + 6y* + 627 = 108 
or —x/E + y'[3V 2) + 2/BV2F =1 


which represents a rotational hyperboloid with one sheet, the x-axis being the 
axis of rotation. 


Exercise 2. The form 
XIX=2+y+2=k (>0) 
represents a sphere with its centre in the origin and radius R = Vk. A= lisa 
triple root of det (R(Z)) = 0, and any vector is an eigenvector of the form matrix 
I. Thus, any orthonormal transformation will leave the form invariant— 
Y = MIM* = MM" =I 
The geometric significance of this last result is quite clear and should be 


with the proof in Section 7.3, p. 85, that a non-indefinite diagonalized and 
normalized matrix Ag, is invariant to orthonormal transformations. 


which transforms A into 
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Exercise 3. An equation such as 2xy = 9 is a quadratic form with the form 
matrix 
01 
At 


which was diagonalized by means of an orthonormal transformation in Exercise 
3, Section 6.8. 
The reduced (or canonical) form of the equation is 
x—y=9 
or (x/3)? — (y/3)? = 1 
representing an equilateral hyperbola. 


8.2. Relative Motion 


Consider two right-handed orthonormal coordinate systems S 
and S’. S’ is assumed to move relative to S, and we now set ourselves 
the task of finding the relationship 
between the velocities and accelera- 
tions of a point expressed in either 
S- or S’-coordinates. 

In S, the position vector of point s! 

P is R, and in S’, R’. Expressed 
in matrix notation, the connexion 
between the coordinatesof Rand §$ 
R' is 

R=Q+MR’ .. (8.3) 

. ‘ Fic. 8.1. ApsovuTe AND RELATIVE 
where M is an orthonormal matrix Motion 
which depends upon the position 
of S’ relative to S, and the components of which are therefore 
continuous functions of the scalar time parameter f. 
Differentiation with respect to time gives us 


R=Q+MR’'+MR . . . (84) 


(we employ the Newtonian dot notation). 

R is the velocity of P relative to S; R’, the velocity of P relative 
to S’; and @ + MR’, the velocity relative to S of the fixed point 
in S’ which is instantaneously coincident with P. It is standard 
practice to call these three terms absolute, relative and transport 
velocities, respectively. p 

We shall now study the term MR’ more carefully. 

As S’ moves rigidly relative to S, the components of M will vary, 
the only condition imposed on them being that M shall at all times 
be orthonormal. The relation 


MM, = MM =I jonny & Ra) 
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is thus independent of time, and by differentiation we find 
MM, + MM, = 0 ee” . 18.6) 
or M=—-MMM. . ._ . (87) 
Applying Theorem 15, p. 26, to eqn. (8.7), we get 


det (M1) = — det (M) det (M,) det (M) 
—det(M,) (because det (M) = 1) 
— det (M) (because det (A,) = det (A)) 
from which we infer (by comparing the first and last members of 
the equation) that 
det (M) = 0 
for all values of ¢. 

M will thus always have the eigenvalue zero, and the corresponding 
eigenvector Rg will be instantaneously at rest relative to S’. 

Since MR’ is a linear vector function and MRj = 0, MR’ will 
depend solely on the component of R’ perpendicular to Ro. Also, 
the magnitude of MR’ will be proportional to the distance from the 
terminal point of R’ to the eigendirection determined by Ro. Further- 


more, MR’ and MR’ (the velocity relative to S of the vector R’ 
which is fixed in S’) are orthogonal, since 


(MR’),(MR’) = R{M.MR’ (by Theorem 14, p. 26) 

—RiMMR’ (by eqn. (8.6)) 

—RiMMR’ (by transposition) 

=0 (by comparing the second and fourth 
terms of this string of identities) 


~ MR’ is orthogonal to MR; (the eigenvector of M referred 
to S 


(MR’)(MRo) = RiM|MR, (by Theorem 14) 
=—RIMMR, (by eqn. (8.6) 
= —RiM0 (since Ro is an eigenvector 
of M corresponding to 
4=0) 
=0 


The reader familiar with classical kinematics will recognize that the 
instantaneous motion of S’ relative to S is a rotation about the axis 
determined by Ro. A point R’ in S’ moves relative to S with a 
velocity 

O+wx R’ 


[i ee 


8.3. TENSOR OF INERTIA 95 


(reverting for a moment to classical vector notation), where w x R’ 
is orthogonal to both w (which lies along Ro) and R’, and pro- 
portional to the distance from the terminal of R’ to the axis of 
rotation. 
To find the acceleration of P, we differentiate a second time and 
obtain “antics 2d. is - 
R=(04+MR)+MR'+2MR ._.. (8.8) 


R is the absolute acceleration of P relative to S; 0 + MR’ is 
the acceleration in S of the fixed point in S’ instantaneously coincident 
with R’ (transport acceleration); and R’ is the acceleration of R’ 
in S’ (relative acceleration). R’ is pre-multiplied by M to transform 
it into the S-system. 

Finally, the term 2MR’ is Coriolis’ acceleration. This last term 
of eqn. (8.8) will vanish under three conditions— 


(i) When S" is instantaneously at rest in S (M = 0). 
(ii) When P is instantaneously at rest in S’ (R’ = 0). 
(iii) When R’ lies along the instantaneous axis of rotation (the 
eigendirection of M). 


Note. This section is a typical example of an engineer rushing in where 
mathematicians would fear to tread, at least before they had studied the ground 
more carefully. We have optinaistialy differentiated matrices according to the 
well-known rules for scalar functions without first satisfying ourselves that such 
an operation is in fact permissible. The operator d/dt is linear, however, and 
it is thus a reasonable assumption, which is readily verified, that we differentiate 
matrix products with impunity according to the classical rules, provided the order 
of the matrix factors is not altered. 


8.3. Tensor of Inertia 


As an example of the application of matrix algebra to classical 
mechanics, we shall now consider a rigid body, one point of which 
is fixed by means of a frictionless joint. 

In using the word tensor we have anticipated the contents of 
Chapter 12. For the time being, however, the reader can think 
of a tensor as a matrix representing a class of orthonormally equiva- 
lent (congruent) form matrices such as were discussed in Section 
TA, p. 87. 

The moment of inertia of a heavy body about an axis through 
a fixed point O is defined as the scalar sum of the mass particles 
of which the body consists, each multiplied by the square of its 
distance from the axis about which the moment is being 
calculated. 

Choosing O as the origin of our system of reference, R as the 
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position vector of the mass particle m, and L as a unit vector defining 
the axis of rotation, the moment of inertia about OQ is 


F=SMPOF : ke BOD 


According to Pythagoras, (PQ)? = (OP)? — (OQ), which in the 
notation of classical vector analysis can be written 


(POP =R?-(L.RP .  . .. (8.10) 
where L . R = OQ, since L is a unit vector. 


0 
Fic. 8.2. MOMENT OF INERTIA OF RiciD Bopy 
Substituting eqn. (8.10) in eqn. (8.9), and expressing the scalar 
products in matrix notation, we get 
J = imR,R — Um(L,RR,L) e + B.1) 


Since L is a unit vector, L,L = L,IL = 1, and by inserting the 
scalar factor mR,R between L, and I, eqn. (8.11) can be rearranged 
as follows— 

J = SL (mR,RDL — SL(mRR)L 
= L(2(mR,RI — mRR))L 


Zm(y? + 22) | —Xmxy —imxz 
=L,) —Zmxy <Inm(x?+2) —Xmyz L 
—mxz —Xmyz = =Xm(x* + y*) 


J, a —D, _— D, ez 
=L,3SDy) OU, = Dk 
0. (a D, vz J, z 
= L,TL e : é ; 4 5 : - (8.12) 
J,, J, and J, are the moments of inertia about the coordinate axes; 
the D’s are the products of inertia (or deviation moments) of the 


body with respect to the coordinate planes; and T is the tensor of 
inertia of the body corresponding to the point O. 
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T is symmetric and will therefore always have three real eigen- 
values, J;, J and Js, which are called the principal moments of 
inertia. The associated eigendirections are the principal axes of the 
body through point O, and when we swing the coordinate axes 
round to coincide with these directions (which are orthogonal), T 


transforms into 
J, 0 0 
r={0 Js a| 
0 0 YS, 


From physical considerations it is obvious that the principal 
moments of inertia can never be negative. Hence, the central 
quadric surface associated with the symmetric matrix T is an ellip- 
soid (the ellipsoid of inertia), the principal semi-axes of which are 
equal to the reciprocals of the square roots of the principal moments 
of inertia. 


Exercise 1. As a beautiful example of the way in which matrix algebra, 
assisted by geometry, enables us to visualize and solve problems that would 
otherwise require laborious calculations, we shall discuss the moments of inertia 
of a homogeneous cube about lines through its centre. 

For reasons of symmetry, the deviation moments are zero when we place the 
coordinate system with its axes perpendicular to the faces of the cube. For the 
same reason the moments of inertia about these axes are equal. 

Hence, the ellipsoid of inertia is a sphere, and the moment of inertia of the 
cube about any line through its centre is a constant. 


Exercise 2. The property of a form matrix that its trace (i.e. the sum of the 
elements along its main diagonal) is invariant to orthonormal transformations 
can now be interpreted mechanically: the sum of the moments of inertia of a 
rigid body about three perpendicular axes through a fixed point is a constant. 

‘This can easily be proved directly by compiling the trace of the matrix of 
eqn. (8.12)— 

Jn + Sy + J, = 2m? + y? + 2*) = 2EmR,R 


which is seen to be independent of L. 
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8.1. Determine the centre and the principle axes (the eigendirections) of the 
quadric surface 


8x2 + L1y® + 82° + 4yz + 82x — 4xy — 16x — 4y — 82 -4=0 
Method. Translate the coordinate system so as to eliminate the linear terms; 
then determine the eigenvalues and eigenvectors of the form matrix. 
8.2. Discuss the central quadric surface xy = z*. 


8.3. Give a geometric interpretation of the normalizing process described in 
Section 7.3, p. 84. 
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8.4. Explain in geometric terms why it is always ible to diagonalize two 
quadratic forms simultaneously, provided that at oust cals of them is positive 
definite. Is this requirement necessary ? 

8.5. Show that eqns. (8.3), (8.4) and (8.8) remain invariant in functional form 
when we make S’ the “absolute” and S the “relative” coordinate system. Hint. 
Note that pre-multiplication by M transforms vectors from S’ into S, and (since 
M is orthonormal) M; = M- will transform vectors from S into S’. 

8.6. Prove that the velocity relative to S’ of the fixed point in S instantaneously 
coincident with P is equal to the negative of the velocity relative to S of the fixed 
point in S’ instantaneously coincident with P. Hint. Make use of eqn. (8.6). 

8.7. Verify the expanded form of the expression 2(mR,RI — mRR,), given 
in eqn. (8.12). 

_ 8.8. Calculate the tensor of inertia at 0 of a composite body consisting of 
six heavy particles m placed in positions (+1, 0, 0), (0, +1, 0) and (0, 0, 0. 

8.9. Use the tensor calculated in Problem 8.8 to determine the moment of 
inertia of the body about the axis determined by the vector (1, 1, 1). Compare 
this result with the value obtained by direct calculation. 

8.10. Repeat Problems 8.8 and 8.9 omitting the particles on the z-axis. 

8.11. Compute the tensor of inertia at 0 of a composite body consisting of 
three heavy particles m placed at the three points (1, 0, 0), (0, 1,0) and(—1, —1, 1). 
Find the principal axes of the body. 

8.12. Compute the tensor of inertia at 0 of a heavy Pee m placed at point 
(1, 0, 0). Sketch the (degenerate) ellipsoid of inertia of the body. 

8.13. Choose a suitable Cartesian coordinate system and compute the tensor 
of inertia of a thin, heavy rod of mass M and length 2/ about its centre. Determine 
the corresponding ellipsoid of inertia. 

8.14. Calculate the tensor of inertia at the centre of a homogeneous circular 
disc of mass M and radius R. 

8.15. Discuss the central quadric surface corresponding to a form matrix 
with (i) one eigenvalue equal to zero, and (ii) two eigenvalues equal to zero. 


CHAPTER 9 


Linear Programming 


9.1. The Problem of Linear Programming 


DurING recent years, linear algebra has found interesting and 
unexpected applications in industry and commerce under the name 
of linear programming (L.P.), which originated in military operations 
research. In this chapter we shall confine ourselves to a brief 
exposition of the problem of L.P., followed by a cursory discussion 
of the mathematical aspects of the subject. 

Suppose that a certain industrial undertaking manufactures n 
different items, the quantities of which are x; (> 0) (i= 1, 2,. . ., ), 
and that the x, can be sold at a net profit c; on a market which does 
not exhibit any saturation effects. Let us assume further that the 
x; are not completely independent of each other. For instance, x, 
may be produced from the waste products of item x,; hence x, and 
X are linked by an expression of the form 


4X, + 4X2 = 0 


Interdependence might also occur if x, and x, were manufactured 
by the same machine (a loom, for example, can be adjusted to pro- 
duce rolls of cloth of different width). 

The problem of L.P. is now to determine a production schedule 
which will take these limitations into consideration and at the same 
time yield a maximum profit. Linear programming has also been 
applied to transportation problems, in which case the aim of the 
analysis is to reduce costs to a minimum; the L.P. technique is, 
however, mutatis mutandis, precisely the same in each case. 

Stripped of all its trappings, the mathematical formulation of the 
problem of linear programming is as follows. 

Determine » non-negative numbers x, such that the m(<n) 
equations of constraint, 


AyX + Ayre +. + AnXn = by 
: : wan : : (9.1) 
ny Xy + AmgX +. + » + AmnXn = Om. 
99 
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are satisfied, and the scalar product, 


f= CX = CX; . e + (9.2) 


attains its maximum value. 
Expressed in terms of compound matrices, eqns. (9.1) and (9.2) 
read 


AXine (Ay > CREAMER! BAK) {Fh Sip of Aa) 
and f=f)=CX=amaximm .  . (20) 


where X, and X, are m-dimensional and (” — m)-dimensional 
vectors respectively. 
A solution to eqn. (9.1a) which, however, will not in general 
make f a maximum is 
x’ = {Fao} 93 
=10 4 : d - 9.3) 
where Xp =(A,...A,)7°B >. : - (9.4) 
and the complete solution is 
X = X’ + the (n — m)-dimensional nullspace of A 


Bearing in mind that the coordinates of X must be non-negative, 
the solution space (or cell) K of eqn. (9.1a) is the intersection of a 
non-centred E,,,, and the positive n-dimensional orthant (i.e. the 
2th part of m-space in which all coordinates are > 0). 

It now remains to determine the vector X belonging to the cell 
K which yields a maximum scalar product f with the constant 
“profit vector” C. 


9.2. Definitions 
Before proceeding to a detailed discussion of the manner in which 


the maximum value of f is computed, we shall have to define a 
number of new concepts. 


Definition 1: Convex Polyhedron (or Convex Cell). Let V;,. . ., V, 
be a set of vectors; then the set of vectors X such that 


Kee elvt Su... O3) 


So=1 


where v; > 0, and 


9.3. PROPERTIES OF THE SOLUTION CELL K 101 


is termed the convex polyhedron (or cell) generated by V,,. . ., V,. 
We shall also use the expression convex linear combination for such 
a combination of vectors. 


Exercise. The simplest convex polyhedron consists of a single point defined 
by one position vector V,. In this case p = 1, and v, = 1. 
When p = 2, the polyhedron becomes the line segment connecting the terminal 
points of the generating vectors V, and V2, and we have 
X=w,+(—ov, 
=¥,+0¥%,-V.) O<v<1) 


An alternative definition of a convex set is a set of points such 
that, if X, and X, are the position vectors of any two points belonging 
to the set, then all the points on the segment joining them also 
belong to the set. 


Definition 2: Extreme Point (Vertex) of a Convex Set. An extreme 
point of a convex set is a point which does not lie on a segment 
joining two other points of the set. 


Theorem 37. When the generators of a convex polyhedron are 
linearly independent, a point of the set will be an extreme point 
when, and only when, it is a point determined by one generator. 

This theorem follows immediately when we recall that none of 
the generating vectors can be expressed as a linear combination of 
the others. Hence the equation 


V,=1V,+...+9%,4+...+0,V, 
or uV,+...+4@—-—)DVy4+...+0,V,=0 


has the unique solution v, = 1, and hence v; = 0 (i 4k), which 
proves that a generator determines an extreme point. 

Conversely, let W be an extreme point; then W must be one of 
the generators, for, if it were not, it would be a unique linear com- 
bination of two or more of the generating vectors, thus contradicting 
the hypothesis that it is an extreme point. This proves the theorem. 


9.3. Properties of the Solution Cell K 

We have seen in Section 9.1 that the solutions to eqns. (9.1) 
comprise a set K which is the intersection of the positive n-dimensional 
orthant and the non-centred solution space E,,_. 


Let V, and V, be two such solutions; then, from eqn. (9.1a), 


AQV, + 0,V 2) = AV, + AV, = 0,B + vB 
= (v, + v,)B=B : : - (9.6) 


5—(T.1046) 
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which means that any point on the convex segment spanned by 
V, and Vy is also a solution to eqns. (9.1). This result enables us 
to state the next theorem. 


Theorem 38. The solutions of eqns. (9.1) form a convex set. 
Any point of K can therefore be written as a convex linear combina- 
tion of the generators K; (i= 1,. . ., p <n) of K. 

The scalar product of C and X, where 


X=SKK, (kj 50 and =k, =1) 
1 


is thus 
f= C,Zk,K, = Xk {(C,K,) 


Let C.K, = M be the largest of the terms C,K,. Seeing that the 
k, are non-negative, it is clear that f will not decrease if we substitute 
M for C,K;, in the above expression for f. Hence 


f= Zk(C,K) <Zk,M = M 


If C,K, takes on the same maximum value M for a number 
(sayi=1,.. .,q <p) of the K,, then any convex linear combina- 
tion of these generators will yield the same scalar product with C. 


C(SKK) = Sk(CK)=kM=M —, (917) 


These results are summed up in Theorem 39. 


Theorem 39. The scalar product C,X, where C is a constant 
vector and X belongs to the convex set K, takes on its maximum 
value at an extreme point of K. If it is a maximum at more than one 
such point, any convex linear combination of these points will 
yield the same maximum value. 

Yet another important property of the extreme points of K is 
given in the following theorem. 


Theorem 40. The number of non-zero coordinates of an extreme 
point X of the convex cell K never exceeds m, and the m-dimensional 
vectors A; (see eqn. (9.1a)) corresponding to the non-zero coordinates 
of X are linearly independent. 

To prove this theorem, suppose p > m coordinates of X are 
positive, and let X be an extreme point of K. Without any loss of 
generality we can assume that the first p coordinates of X are > 0. 
We now have 

MAY +...+%,A,=B . 5 - (9.8) 
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where the p m-dimensional vectors A; must be linearly dependent 
because p > m. This means that 


50/1 se a 29°5) 


where not all the d,’s are zero. 
Multiplying eqn. (9.9) by +A and adding it to eqn. (9.8), we get 


P. 
20% + hd))A; = B 


By choosing h sufficiently small we can make all the coefficients 
x; + hd; positive (x; > 0), which in turn means that the n-dimensional 
vectors X, and X, with coordinates x; + hd; and x, — hd,, respec- 
tively, both satisfy eqn. (9.8) and generate a convex segment which 
contains X (= }X, + 4X,), thus contradicting our hypothesis that 
X is an extreme point. This proves that the A,’s (i= 1,. . ., p) 
are independent, and therefore p < m. 

The solution to the L.P. problem must thus be sought at the inter- 
section of the solution £,,_,, (which is non-centred) and the positive 
coordinate £,,’s of the n-dimensional space in which the problem 
is immersed. We have shown in Exercise 1, Section 4.5, that the 
general intersection in an £,, of an E,,,, and an E,, is an Ey (a point). 


9.4. Dantzig’s Simplex Method 


Up to now we have stated the problem of L.P. and established a 
number of theorems concerning the properties of the solution cell 
K and the required vector X. In this section we shall sketch briefly 
a technique for determining the optimal solution to the problem. 

First we shall explain the purpose and use of slack variables and 
artificial unit vectors. 

Slack variables are introduced in order to change an inequality 
into an equation. Suppose one of the members of eqn. (9.1) had 
read 

AX, + AyX_ <b : é - (9.10) 


To satisfy this inequality the components of X in the x,-x, plane 
must lie in the shaded area of Fig. 9.1(a). 

OAB is a convex cell which cannot be generated in 2-space by a 
set of linearly independent vectors. By adding an extra dimension 
to our space, as shown in Fig. 9.1(b), we avoid this difficulty and 
inequality (9.10) becomes 


UX, + OX, 4+% iy =b . 3 . (9.11) 
where x, > 0. 
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The extra coordinate x,,,, does not represent any actual product, 
and the corresponding coordinate of the augmented vector C is 
zero. If the final solution contains non-zero slack variables, this 
will be an indication that maximum profit can be achieved when 
certain machines in the plant are running at less than full capacity. 
Each slack variable x;(i= n+ 1,. . .) will be associated with an 
m-dimensional unit vector U, in the matrix of constraint A. 

The introduction of artificial unit vectors is a device designed to 
evade the necessity of inverting the matrix given in eqn. (9.1a). 
Originally, matrix A may or may not contain m-dimensional unit 


2 


n+1 
(a) (b) 
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column vectors. Every slack variable has added a unit vector to the 
set. We now complete the set of unit vectors by adding artificial unit 
vectors to make up a total of m. 

The associated variables x; do not correspond to any products, 
and to ensure that they shall not appear in the final solution, we 
make the corresponding coordinates of C equal to —P, where P 
is an unspecified large positive number. 

After renumbering the coordinates of X so as to place the m unit 
vectors U; in the first m columns of the augmented A matrix, we 
arrive at the equation 


HU, +. + kU + Xeirdmes ++ XgAy = B . (9.12) 


Each vector of the left-hand member of this equation is associated 
with a coordinate of the profit vector C. In the case of a vector which 
was present in the orginal matrix of constraint (A), the corresponding 
coordinate is c;, while the unit vectors that have been introduced in 
connexion with the slack and artificial variables correspond to 
coordinates of C that are 0 and —P, respectively. 

By inspection it is seen that 


= {F fori=1,...,m 
10) fori=m+1,...n 
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is a solution of equation (9.12) which must represent an extreme 
point of K, because the column vectors of A associated with the 
non-zero coordinates of X are independent. 

The total profit for this X is 


va Ox = eb, aA CES 


which, however, is not as a rule the required maximum. 
Using this vertex of K as our point of departure, we now apply 
the simplex method by substituting a vector from the set 


it een ae 14 


for one of the m unit vectors U; in such a way that— 
(i) Eqn. (9.12) is still satisfied. 


(ii) fis increased as much as possible. 
(iii) None of the new x,’s is allowed to become negative. 


The first m vectors U,,. . ., U,, of A form a base in terms of which 
all the other column vectors of A can be expressed. Thus 
Ay = aU, +. © 6 + AU, : - (9.14) 


where a;, are the m coordinates of A,. 
Multiplying eqn. (9.14) by 4 and adding it to eqn. (9.12), we find 
that 


m 
Dd; — hay)U; + hA, = B : - (9.15) 
T 
The coordinates of the new vector X’ are 
b; — hay, fori<m 
x= 4h fori=k>m 
0 fori #AK)>m 


and the new value of fis 
f= Zeb — haj,) + he, 
™m 
=f+ he, — 2x) 


=f+hce—g,) . : ; - (9.16) 


Egn. (9.16) enables us to pick the value of k that will result in 
the greatest increase, 
Sf —f= We, — 8%) 


106 ' LINEAR PROGRAMMING 


in the total profit; A is positive (it is a coordinate of X’), and we 
shall therefore choose k such that 


C, — g, (> 0) = a maximum 


This done, the choice of h is governed by the consideration that one 
of the 


x,=6;—ha,  (i<m) 
must be zero and the remainder greater than zero. 
Hence h = (bag) min @=1,...,m) 


where only positive a,,’s are considered. 

In this manner we obtain a maximum increase in f, and at the same 
time elminate one of the terms x,, while keeping the remainder 
non-negative. i 

Let the rth coordinate of X(r <_m) be the one that vanishes. 
Eqn. (9.15) then becomes 


b, he 
(6, Zan) U4. 40.0, 4 2. + Bn — 7, Ak ae 


— = B - (9.17 
+ Tox, Ae wnt) 

The coordinates of the new position vector X’ can be read from 
eqn. (9.17). It will be noted that the rth coordinate vanishes and that 
coordinate k, which was zero in X, now becomes x, = h = bax. 

Another way of interpreting the coefficients of the vectors in 
eqn. (9.17) is to look upon them as the coordinates of B in the co- 
ordinate system formed by the vectors A, and U,(i=1,..., 
r—I1,r+1,...,m). 

If we wish to calculate the coordinates of any other vector (say A;) 
referred to this base, we proceed as follows. Solving eqn. (9.14) 
for U,, we get 


. (9.18) 


After making k = j in eqn. (9.14), and employing the above expres- 
sion for U,, we obtain an expression for A in terms of the new base— 


4g, ans 
A, = ——a Ju +A, . 
Z 2 (a, Gn st a aed 


where m <j <n. 
Using these values for the coordinates of B and the vectors A;, 
we prepare for the next step of the simplex analysis by compiling 


. (9.19) 
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the new values of c; — g, in order to decide whether we have 
reached the final solution (all c; — g; = 0), or whether it is still 
possible to increase f by replacing one of the vectors of the base by 
a new A, 


9.5. Solutions at Infinity—Multiple Maxima—Degeneracy 

An exhaustive discussion of the simplex method lies outside the 
scope of this book. We shall therefore have to content ourselves 
by giving a geometrical explanation of the various difficulties that 
may arise during its application. 

To recapitulate: the problem of linear programming is to deter- 
mine a vector X, constrained to lie within an (n — m)-dimensional 
cell K in n-space, such that the projection of X onto a vector C is 
as large as possible. 

We have proved that K is a convex cell, that the point or points 
of K which make f'a maximum form a convex subset of K (usually 
consisting of one vertex), and finally that the position vectors of 
the vertices of K never have more than m non-zero coordinates. 

In the case n = 3 we are able to visualize the problem directly. 
When m = 1, the convex solution cell K is a triangle spanned by 
three points on the positive axes; whereas, when m = 2, it consists 
of a line segment connecting two points in the positive coordinate 
planes. 

Both these cases are illustrated in Fig. 9.2. 

In the higher-dimensional case our spatial intuition fails us, but 
we can still picture K as consisting of a number of vertices connected 
by line segments (edges) to form what topologists call a connected 


Geometrically speaking, the simplex method consists in moving 
along the edges of the solution cell from vertex to vertex in such a 
way that each step increases the value of /. 

The numerical calculations can be arranged in a tableau so as to 
show at a glance which adjacent vertex will give the greatest increase 
inf. 

It is necessary to know the coordinates of one vertex (any one) of 
K before the simplex method can be employed. The introduction 
of artificial variables is, in fact, a technique by which the basic n-space 
of the analysis is augmented by the addition of extra reference axes. 
By this means a vertex is created from which to start the search 
for the maximizing point of K. The severe penalty —P attached to 
the artificial variables ensures that they cannot appear in the final 
solution; in other words, we are eventually forced out of the artificial 
annex and back into our basic n-space. 
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Three special situations may arise during the computation— 


(i) It was shown in Section 9.3 that the vertices of K must be 
sought at the intersections of the non-centred solution E,_1m of the 
constraining eqn. (9.14) and the positive coordinate £,,’s of the 
n-dimensional coordinate system. 


3 


1 
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If, however, the E,,_,,’s and a coordinate E,, happen to have a 
p-direction in common, the corresponding vertices lie at infinity; 
also, if one (or more) of the m non-zero coordinates of a vertex is 
negative, the cell K will be unbounded. In either case the L.P. 
analysis may lead to the result that the total profit f will increase 
without limit when certain coordinates of X tend to infinity. 

(ii) A second type of difficulty occurs when a convex subcell 
K, of K is at right angles to C. All the position vectors of K, will 
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have the same scalar product with C, and if the corresponding value, 
J» is a maximum, the manufacturer can employ any vector in K, 
as the basis of his production schedule. His final choice of X will 
now have to be decided by considerations not originally incorporated 
in eqn. (9.1a). 

Under these circumstance Theorem 40, p. 102, can be ignored and 
the solution may comprise more than m non-zero x,’s. 

(iii) Finally, there exists a type of computational irregularity that 
has been given the name degeneracy. It occurs when more than one 
unit vector disappears during the process of changing the base 
vectors A; (see eqn. (9.17)). The resulting vector X has less than 
m positive coordinates. This difficulty, which is inherent in the 
simplex method, causes uncertainty as to the next step to be taken 
in the vertex-by-vertex search for a maximal solution. It can be 
overcome by means of a perturbation technique equivalent, geo- 
metrically, to a slight linear distortion of the solution cell K. 


PROBLEMS 


9.1. In connexion with Theorem 37, show that when the generators of K are 
not linearly independent, an extreme point is determined by a generator, but 
that the converse statement need not be true. 

9.2. Determine a 4-dimensional vector X lying in the positive orthant and 
subject to the constraining equations 


00 2 1 10 
—7 1 2 —-5+>X=7414 
6 0 —4 1 4 


such that its scalar product with the profit vector C with coordinates 
(2, —1, 10, 20) is a maximum. 


CHAPTER 10 
Linear Network Analysis 


10.1. Preliminaries and Definitions 

Linear network analysis is fundamentally important to an electrical 
engineer. In this chapter we shall show how matrix algebra can be 
applied with advantage to the study of linear networks, and how 
geometry and topology combine to shed quite a new light on the 
subject. 

The adjective “‘linear” can be applied to a network when the 
elements from which it is built (resistors, capacitors, self- and mutual 
inductors, etc.) are proper constants that are unaffected by the 
currents flowing through them or the voltages applied across them. 
This condition is very nearly satisfied for a great variety of the net- 
works in practice. The differential equations describing the per- 
formance of a linear network have constant coefficients, and the 
condition of linearity (see eqn. (6.11)) is therefore satisfied: When 
certain excitations E,(t) and £,(t) of a network result in responses 
R(t) and R,(t), respectively, the combined excitation k,£,(#) + 
k,E,(t) will cause the response k,R,(t) + k2R(t) for any values of 
k, and k,. In practice, of course, k, and kz will be allowed to vary 
only within specified limits. ; 

Topologically, any network is described in terms of the following 
concepts— 


(i) Branches. A branch consists of one element or a number of 
elements in series; all elements of a branch carry the same current 
under all conditions. 

(ii) Nodes, The terminals by means of which a branch can be 
connected to other branches are called nodes (junctions). 

(iii) Node-pairs. Any two nodes of a subnetwork (see (vi)) con- 
stitute a node-pair. A connected network with m nodes has $n(n — 1) 
node-pairs. 

(iv) Meshes. A closed path traced through a network is called 
a mesh (loop). 

(v) Open Meshes. An open path traced through a network, 
starting at one node and ending at another, is termed an open 
mesh. 
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(vi) Subnetworks. A connected subset of branches not electrically 
connected with the rest of the network is called a subnetwork. 
Subnetworks may, however, be coupled magnetically. Also, two 
networks with only one node in common can be considered to be 
distinct subnetworks. 

(vii) Graphs. The graph of a network is a diagram in which each 
branch of the network is indicated by an oriented line. 

(viii) Trees. A tree on a connected network is a graph correspond- 
ing to a set of branches connecting all the modes of the network 
without forming any meshes. 

(ix) Cotrees. A cotree on a connected network is the graph of 
the complement of a tree on the network (i.e. the graph of the branches 
that remain when the branches of the tree have been removed). 
The branches of a cotree are called Jinks. 

(x) Cut-sets. A cut-set (a set of tie branches) of a network is a 
minimal set of branches which, when detached, divides the network 
into at least two subnetworks. 

(xi) Cocut-sets. A cocut set (a set of coties) is a minimal set of 
branches which, when short-circuited, divides the network into at 
least two subnetworks (which will have a node (ornodes) in common). 


With the help of the concepts free and cotree, we can prove a 
fundamental topological theorem known as Euler’s formula. 

Let us construct a network by first joining branches together to 
form a covering tree, and then adding branches of the corresponding 
cotree until the network is complete. 

The first branch of a connected network contributes two nodes, 
and for each subsequent branch that we add to the tree, we also 
add a new node. If the network comprises s unconnected subnet- 
works, we thus find in 

b=n-—s=p F - - (10.1) 


where b, is the total number of branches in a tree on the network, 
and n the number of nodes. 

When we connect a branch belonging to the cotree, we are not 
creating any more nodes, since by definition the branches of the tree 
connect all the nodes. Each new branch will, however, complete 
amesh. This is clear, since a branch of the cotree must join two nodes 
of the tree, and these nodes are connected through the tree via a 
unique path. Such a mesh passing through the tree plus one branch 
of the cotree (a link), is termed a basic mesh. Thus we conclude that 


Benin, Din, arg Vk NAO) 
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where by is the total number of branches (links) in the cotree. By 
adding eqns. (10.1) and (10.2), we get 


b+bp=b=m+(n—sJ)=m+p - (10.3) 
which, expressed in words, reads— 


Theorem 41 (Euler’s Formula). The number of branches (6) of a 
network is equal to the number of independent meshes (m) plus the 
number of independent node-pairs (n — s = p). 

This theorem does not depend on whether or not the network 
is planar. 


Problems in network analysis are usually stated as follows. The 
b branch impedors together with the mutual couplings between them 
are known. Also, certain impedanceless sources of constant e.m.f. 
in series with the branches and certain admittanceless sources across 
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the branches are given. It is required to determine the branch cur- 
rents and the voltages appearing across the branches. This is done 
by means of Kirchhoff’s two equations in conjunction with Ohm’s 
law. 

Kirchhoff’s first law (Kirchhoff I) states that, at any instant, the sum 
of all the currents flowing towards a node is equal to the sum of all 
the currents flowing away from it. This self-evident idea implies the 
conservation of electric charge and has its generalized counterparts 
(using the divergence operator) in aero- and thermodynamics. 
Kirchhoff I yields p independent constraining relations between the 
branch currents. 

According to Kirchhoff’s second law (Kirchhoff II), the sum at 
any instant of the potential differences (active and passive) round a 
closed mesh is zero. This is a reformulation of the principle of the 
conservation of energy, and leads to m independent constraining 
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equations between the branch p.d.s. The generalized version of 
Kirchhoff II uses the rotation (or curl) operator. 

To avoid confusion and errors, it is imperative that a definite 
system of orientation of currents and voltages be decided upon and 
strictly adhered to. For the sake of generality, we shall assume that 
each branch contains a series-connected source of e.m.f. e, and a 
parallel-connected source of current J,, as indicated in Fig. 10.1. 

The meaning of the symbols is obvious in the case of the currents, 
and the polarity convention for voltages is such that the p.d. between 
two nodes is taken as positive when the node at the arrow-head is 
at a higher potential than the other. 

Hence, the current flowing through the branch immittance 
(impedance or admittance) is 


Kk=itT (G=1,...,6) : - (10.4) 
and the p.d. appearing across it is 
Vi=e,+&, . : 3 - (10.5) 


Exercise. In order to illustrate the concepts introduced in this section, let 
us consider the network shown in Fig. 10.2. The circuit consists of 2 (= s) 
magnetically coupled subnetworks N, and Nz. It comprises 8 (=m) nodes 
(A, B,. . ., H), and 13 (= ) branches (a, b,. . ., 0). Any two nodes belonging 
to the same subnetwork (CE, AB, HG, etc.) form a node-pair. Subnetwork Nj, 


E & 
[| 


Subnetwork N> 


Subnetwork N, 


Fic. 10.2. ExampLe or Network 


for instance, comprises $7,(m, — 1) =} x5 x4=10 node-pairs, the p.d.s of 
which can be expressed as linear combinations of n, — 1 = 4 independent 
node-pair p.d.s. 

Acclosed path such as ABDECA through the network is a mesh, and by means 
of Euler’s theorem we can calculate the number of independent meshes to be 
m=b-—n+s=13-8+2=7. 

The branches 6, d, g and h form a tree on subnetwork Nj, and the remaining 
branches a, c, e, j and f make up the corresponding cotree. It is readily seen that 
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a number of other trees exist on Nj, and also that any such tree must contain 
exactly n; — 1 = 4 branches. The reader should choose a tree on N, and then 
indicate the corresponding basic meshes, each of which links with a branch of 
the cotree and is completed by means of a unique path through the tree. 

If the branches c¢, d, e sa fare detached from N;, the subnetwork will be 
divided into two unconnected parts. These branches therefore form a cut-set 
of N;. Branch d forms a cocut-set of Nj, since, when d is short-circuited, Ny 
will be separated into two networks which have only one node (B = C) in common. 


10.2. Connexion Matrices—Kirchhoff’s Laws 


It was mentioned in the previous section that each branch has 
a current i; flowing through it. We shall arrange these currents as a 
b-dimensional vector and denote it by a single symbol i. The co- 
ordinates of this vector are not independent, however. The branch 
currents must obey Kirchhoff I, which allows i only m degrees of 
freedom. Maxwell realized this fact when he introduced his m 
independent mesh currents i’. The relation between i and 7’ can be 
expressed by means of a b-by-m mesh-connexion matrix C. 


i= Ci’ . A 5 . (10.6) 


The connexion matrix uniquely determines the way in which the 
branches are connected to form a network (see Exercise 2 below). 
The converse is not true. 

With the introduction of independent mesh currents, Kirchhoff I 
is automatically satisfied. To derive an expression for the driving 
e.m.f.s acting in the m meshes, we make use of the fact that the 
instantaneous input of power to the network cannot depend on 
whether we consider branch or mesh quantities. Thus 


Paig=wte’. . .  . (10.2 


where e is the b-dimensional column vector containing all the branch 
e.m.f.s and e’ is an m-dimensional vector whose coordinates are 
the mesh e.m.f.s. 

Substituting eqn. (10.6) in eqn. (10.7), we get 


UC e Te Se 5 -o1e€108) 
from which we can conclude that 
e=Ce . 3 < - (10.9) 


since eqn. (10.8) must be valid for all values of 7’. 
Using the branch p.d.s E; as our unknowns, we can develop the 
dual of the mesh method of analysis when we note that the £,’s 
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are not independent but must meet the requirements of Kirchhoff II. 
Expressing the b £,’s in terms of p independent node-pair voltages 
E’, we arrive at the dual of eqn. (10.6)— 


E=AE’ . 5 F « (10.10) 


where A is called the node-pair connexion matrix. By analogy with 
the term basic mesh, defined on p. 111, we term a node-pair across 
a branch of a tree on a network a basic node-pair. 

The currents I impressed across the branches can be expressed as 
linear combinations of a set of currents I’ injected across the p 
independent node-pairs— 

r=Al . ; : - (10.11) 


the proof of this formula being the dual of that of eqn. (10.9). In 
this case, P = I,£ = 1,A,E = 1;E’ is an invariant. 

A fascinating relationship exists between the two connexion 
matrices of a network. Both have 6 rows, so that the pre-product 
of the one by the transpose of the other is always defined. 

Viewed as linear operators their significance when employed as 
pre-factors is set out in Table 10.1. 


Table 10.1 
OPERATIONS PERFORMED BY CONNEXION MATRICES 


combines m mesh quantities to form 6 branch quantities 
sums branch quantities acting round m meshes 

combines p node-pair quantities to form 6 branch quantities 
sums the branch quantities converging on p nodes 


Suppose m independent mesh currents i’ are given; the branch 
currents are then i = Ci’. Kirchhoff I is automatically satisfied, so 
that, when we sum the branch currents flowing towards the p in- 
dependent nodes of the network, the result is a p-dimensional null- 
vector. Thus 


AC’ =0 . : : + (10.12) 
This identity holds for all i’, so therefore 
jo | ara dies 0) 6) 


Apparently, the column vectors of C span the nullspace of A, and 
vice versa. 
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Exercise 1. Compute C and A for the bridge network of Fig. 10.3, and test 
the validity of eqn. (10.13). 
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In this case b = 6,n = 4,5 =1,p =3 and m =3. After numbering and 
orientating the branches, node-pairs and meshes, we can compute the connexion 
matrices— 


1 0 0 

1 0 -1 

-1 1 0 

A (Spams and 
0-1 1 

0} oto ta 

i ale 

ah (fil 20 

0 1 0 

and A= gt *oT 44 
o 1-1 

1 0 -1 


It is readily verified that A,C = 0, and, by transposition, that C,A = 0. 


Exercise 2. Reconstruct the network from either the mesh connexion matrix 
C or the node-pair connexion matrix A. 

We shall not discuss the solution of this problem in detail, but merely point 
out that each column of C indicates and orients the branches forming the cor- 
responding mesh. Similarly, each column of A lists and orients the branches 
converging on the corresponding node. The reader will discover for himself 
that it is usually easier to construct the network from matrix A than from C. 


10.3. Mesh Method of Analysis 


Irrespective of the configuration of the network, Ohm’s law must 
apply to each and every branch immittance: The potential difference 
V, will include, not only the voltage drops caused by the branch 
currents, but also, in the case where magnetic coupling exists between 
the branches, e.m.f.s induced in the branch immittance by currents 
in other branches. 

If we arrange the self- and mutual inductances of the branches in 
a b-by-b impedance matrix Z (the primitive impedance matrix), we 
can write Ohm’s law simultaneously for all branches as 


PSE pes7e+p=zZ S04) 


10.3. MESH METHOD OF ANALYSIS 117 


The elements along the main diagonal of Z are the self-impedances 
of the branches, and the element in position ij is the transimpedance 
of branch j into branch i. 

Summing the V round the m meshes is accomplished, as shown in 
Table 10.1, by pre-multiplication by C,. Hence 


CV =CE+Ce=0+e' =C,ZCi' + C,ZI . (10.15) 


where Z’ = C,ZC is the m-by-m mesh impedance matrix of the given 
network. 

Solving eqn. (10.15) for i’ and using eqns. (10.6) and (10.9), we 
arrive at an expression for the required branch currents in terms of 
the applied branch e.m.f.s e, the injected branch currents J, the 
primitive impedance matrix Z, and the connexion matrix C— 


i = C(C,ZC)C(e — ZI) . . (10.16) 


(b) 
Fic. 10.4. EquivALent MesH Circuit OF TRIODE 


When the only active sources in the network are the series branch 
e.m.f.s e (i.e. when I = 0), eqn. (10.16) becomes 


i=C(GZo-ce . . . (017 


To obtain the unknown node-pair p.d.s, we solve eqn. (10.14) for 
Eand substitute expression (10.16) fori. Hence, after some manipula- 
tion, 

E=(ZC(C,ZC)*C, —I(e—ZD . . (10.18) 


In the case of passive networks, the impedance matrix Z is sym- 
metric. When, however, an active element, such as a vacuum tube, 
is connected in the circuit, the matrix immediately loses its symmetry, 
as we shall demonstrate by the following example. 
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Consider the circuit of Fig. 10.4. For Class A operation the triode 
can be replaced by its equivalent circuit as shown at (a), and we 
arrive at the three mesh equations, 


= Ri Y 
He, = —Bi, — (B + ry)is 
e= Bip + Bi, 


Eliminating i, and writing the equations in matrix form, we find 


=) [44] R, 0 AL 
bbe {e} {— parte +r,) Br,|(B+ rt {i} =Zi 
Viewed as a 2-branch 2-mesh circuit (Fig. 10.4(b)), a network con- 
taining a vacuum tube is represented by a non-symmetric impedance 
matrix Z. 
It is possible to resolve Z into two parts. One of them, 


z,={% 9 


is the branch matrix of the network before connexion of the tube, 
and the other, 


0 0 
i= {_upr,lie +r) —BY(B+ i 


which is unsymmetric, is due to the action of the tube. This de- 
composition is not particularly satisfactory, however, as the elements 
of Z, are also functions of the grid and load resistances, so that Z, 
is not truly a tube matrix. We shall return to this question in the 
next section. 


10.4. Node-Pair Method of Analysis 
With eqn. (10.14) as our starting-point, we obtain the expression 


J=I+i=¥(E+e)=YV . (10.19) 


where Y = Z~ is termed the primitive admittance matrix of the 
network. 

By following a train of reasoning which is the exact dual of that 
employed in Section 10.3, we derive a formula expressing the unknown 
node-pair voltages in terms of the injected currents I, the series- 
connected branch e.m.f.s e, the primitive admittance matrix Y, and 
the node-pair connexion matrix A— 


E = A(AYA)A(I — Ye) 


. (10.20) 
This equation is the dual of eqn. (10.16). 


—— 
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Similarly, 
i = (YA(A,YA)"A, — I — Ye) 
is the dual of eqn. (10.18). 
When e = 0 (i.e. when the excitation consists of injected currents 
T only), eqn. (10.20) reduces to the form 


E = A(AYA)7A,I . (10.22) 


By analogy with the nomenclature introduced in the previous 
section, the p-by-p matrix Y’=A,YA is termed the node-pair 
admittance matrix. 

In the general case, the currents flowing into the electrodes of a 
vacuum tube are functions of all the electrode potentials relative 
to the cathode. This relationship can be most conveniently ex- 
pressed by means of a square differential admittance matrix Y,,. 

For a triode we have 


« (10.21) 


Y= {aren are. - (10.23) 


a1, JOE, 21 OE} 
I, 
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Changes in the electrode currents I for small changes in the elec- 
trode potentials E can be written concisely as 


dI = Y,dE . (10.24) 


If the grid of the triode is not allowed to be positive, the elements 
01,0, and @1,/0E, both vanish and the tube matrix becomes 


0 0 
we te ub 
where g,, is the grid~anode transconductance, and k = 1/r, is the 
anode conductance. 
The equivalent admittance circuit of the triode is shown in Fig. 10.5, 
in which G is the grid-leak conductance and K the load conductance. 
The performance of the network is given by the following matrix 


equation— 
G 0 
t={r, K+ Ene 


. (10.25) 


. (10.26) 
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Y resolves quite naturally into two component matrices, 


mnt 


corresponding to the network before the valve was connected, and 
Y, as given in eqn. (10.25), which represents the effect of the valve 
itself. Its components are functions of the valve constants only, 
and do not depend on the circuit in which it is connected. Valves 
are typical node-pair devices and lend themselves more readily to 
treatment by the node-pair method than by the mesh method. 

The tube matrix given in eqn. (10.23) can easily be generalized 
to cater for multi-electrode tubes. 


Exercise. Matrix analysis of a network by, say, the node-pair method results 


in an expression 
I’ = Y'E’ = AYAE’ . (10.27) 


relating the impressed currents I’ to the response p.d.s E’. 


(a) 


Fic. 10.6. DERIVATION OF VAN DER BUJL’s EQUATIONS 


When the node-pair admittance matrix Y’ is invertible there is a unique 
correspondence between the vectors I’ and E’. A given set of injected currents 
I’ will cause certain p.d.s E’ to appear across the node-pairs, and when I’ = 0, E’ 
must also vanish. 

Tf, however, Y’ is singular, this one-to-one relationship no longer exists, and 
E’ may be % O even though I’ = 0, Under these conditions the circuit is unstable, 
and voltages appear across the terminals of the network in spite of the fact that 
no external excitation is applied. 

Fig. 10.6(@) shows the a.c. circuit of a simple tuned-anode oscillator. When 
the regenerative coupling between the anode and grid coils is sufficiently tight, 
the circuit will break into self-oscillation. In his book The Thermionic Vacuum 
Tube and its Applications, yan der Bijl derives the criterion for oscillation in an 
oscillator of this type by studying the differential equations of performance of 
the circuit. We shall now arrive at the same expression by matrix analysis. 
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Fig. 10.6(b) shows the network before the triode is connected. From it we 
derive the primitive branch impedance matrix Z— 


jol, -joM 0 
Z=4-joM Rijol, 0 +. 
0 0 ~~ Ifjwc 


where the mutual impedance between branches 1 and 2 is taken to be negative 
so as to ensure the correct polarity of feedback. 
Y, the primitive admittance matrix, is the reciprocal of Z— 


: 8 +joL,)/D jwM/D 0 } 
Y=Z'= 


+ (10.28) 


joM|D  jwL,|D 0 . (10.29) 
0 


0 joc 


where D = (M? — L,L,)w® +jaL,R is the subdeterminant derived from Z by 
deleting its last row and last column. D # 0 when w # 0. 
The node-pair.connexion matrix of the network is 


10 
A=,0 1 
01 


and by means of eqn. (10.27) we find the node-pair connexion matrix of the 


etwork to be 
(R+joL/D __jaM|D 
Yn =AYA= 1° igMJD — jol,|D +jeaC 


To arrive at the admittance matrix for the actual oscillator, we simply super- 
impose upon Y}, (see Fig. 10.6(c) the matrix of the triode (eqn. (10.25)). This 


ives us 
. ray gy af{RtjolyD —__ jom|D 
Y= Vn + Ys =} joM[D +.8m joly[D +joC + k 


If oscillations are to develop, det (¥’) must vanish. Hence the complex 
uation ts 
Ns det (Y’) = {1 + (k +/@C\(R + jos) —jOMg}[D =O . (10.32) 


must be satisfied. D is always non-zero and can therefore be ignored. Equating 
real and reactive members, we find 
M =(RC + kLy)/¥n . (10,33) 


which shows how the coupling necessary to bring about the oscillatory condition 
depends on the circuit parameters and the valve constants, and 


+ (10.30) 


- (10.31) 


14+kR—@*L,c =0 ~ (10.34) 
which implies that oscillations can occur only at the frequency 
f= s zs . (10.35) 
ar 


In practice the amplitude of oscillation rapidly increases until its further 
gue is limited by non-linear effects which were not taken into account in the 
above analysis. 
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10.5. Algebraic Diagram of Network Analysis 


In the field of algebraic topology, extensive use is made of dia- 
grams to show the interrelation of algebraic entities. This technique 
can be successfully applied to demonstrate the algebraic pattern of 
network analysis as developed in Sections 10.3 and 10.4. The 
resulting diagram is given in Fig. 10.7. 

From this diagram all the transformations derived in this chapter 
can be read. It should be borne in mind that e and J are b-dimen- 
sional, active, independent vector variables, whereas E and i are 


Node- Branch Mesh 
pair 
B VeE+e e' 


°——_____» +-—_____» » 


P A Cc; 
(A,YA) | lava Y lz cae | (c,ze)" 
At 


° 4. « 


a 5 a 
I vii i 
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response quantities that are constrained by having to obey Kirchhoff 
I and II respectively. 

An arrow in the diagram denotes pre-multiplication by the 
associated symbol. Thus the arrow alongside A, takes J into I’: 


V=AJ=AI+Ai=AI+0=Al — . (10.11) 


Further pre-multiplication by (A,YA)~1 and, subsequently, by A, 
gives us 


E=A(AYAPAI .  . . (10.22) 


It is worth noting that C, C,, A and A, are associated with arrows 
in one direction only; this is because they represent singular matrices 
(r(©) = m and r(A) = p) that cannot be inverted. 

Adopting a geometric point of view, it is apparent that the middle 
part of the diagram, which refers to branch quantities, requires a 
b-dimensional space for its presentation. 

The node-pair end of the diagram is p-dimensional and voltage 
vectors in this space are mapped into b-space by means of the non- 
invertible matrix A. They are confined to the p-dimensional subspace 
spanned by the column vectors of A, and this subspace is orthogonal 
to the m-dimensional “mesh-space” spanned by the column vectors 
of C as evidenced by eqn. (10.13). 
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At the right-hand end of the diagram we have the m-dimensional 
mesh quantities e’ and i’. C maps the independent mesh-currents 
i’ into an m-dimensional subspace of b-space. 

The node-pair and mesh spaces are complementary (together they 
fill all b-space), and this fact is the basis of an approach to network 
analysis which deals simultaneously with node-pair and mesh 
quantities. We shall discuss the orthogonal or mesh-node method 
in the next section. 


Exercise 1. If we limit the excitation of a network to series-injected e.m.f.s e 
only, and let e vary throughout all b-space, will the response immittance voltages 
V (and hence also the immittance currents J) cover all b-space? 

From eqn. (10.14), when I = 0, we have 


V=E+e=Zi . é . - (10.36) 


Superficially, it might look as though V would sweep through all b-space if e 
were allowed to vary freely. It should not be forgotten, however, that E is a 
function of e as well as of I. 

Substituting eqn. (10.18) in eqn. (10.36), we see that V can be expressed in 
terms of the network constants and e as 


Viea2ZCGzoy ce . «© + «(037 


from which it is apparent that the V will only cover an m-dimensional subspace 
of b-space. 

Speaking very loosely, eqn. (10.37) could be described as follows: The operator 
C, squeezes the free b-dimensional vector e into m dimensions; (C,ZC)~ trans- 
forms it into its counterpart in the current space without changing its dimension- 
ality; C injects this current space into b-space; and, finally, the square matrix Z 
carries it into the original b-dimensional voltage space. By consulting 
Fig. 10.7, it can be seen that we have moved in a clockwise direction round the 
right-hand loop of the algebraic diagram, 

Analogously, if we make e = 0 and express V as a function of I only, we arrive 
at the expressions 

V=A(AYAS*AT  . F 5 . (10.38) 
and J=YA(AYA)AI  . : . » (10.39) 
where V and J will cover a p-space when I varies freely. 

On account of the linearity of the network, the simultaneous application of e 
and I will result in 

V = ZC(C,ZC) "Ce + A(A,YA)"Ad. . - (10.40) 
and J = C(C,ZC)"1Ce + YA(A;YA)"Ad. 3 - (10.41) 

As a further exercise the reader should test how these two equations react 

to pre-multiplication by C, and Ay. 


Exercise 2. If we write eqn. (10.40) in the form 
V =ZC(C,ZC)"e’ + A(AYAW’ . . . (10.42) 


it becomes clear that the voltage drops across all the branch immittances and the 
currents flowing through them will be invariant, provided that the independent 
mesh e.m.f.s e’, and the independent node-pair currents I’, remain unaltered. 
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10.6. Orthogonal Analysis (Mesh-Node Analysis) 

Kron was the first. to show the way to a system of analysis com- 
bining the mesh and the node-pair methods. He probably had 
eqn. (10.13) in mind when he called his method “orthogonal analysis.” 
In our discussion we shall sometimes use the words mesh-node 
analysis to mean the same thing. Furthermore, we shall construct 
a canonical (basic) set of mesh-node connexion matrices (A and C) 
by selecting the independent node-pair p.d.s E’ and the independent 
mesh currents i’ as follows. 

To begin with, we select any set of independent node-pairs such 
that each member of the set is the p.d. Ej across a branch. This set 
must define a tree on the network, for if it did not, we should be 
able to pick out a closed loop round which we should have 


XE; =0 


thus indicating that the E/’s were dependent, contrary to our 
hypothesis. 

As the independent meshes we choose the basic meshes corres- 
ponding to the cotree of the tree defined by the E}. 


i; 


+ 
Eh iE 
Fic. 10.8. OPENING A Basic Mes 


The dual of this method of selection is also possible as discussed 
in Exercise 1 below. 

Consider now the node-pair connexion matrix A with one row 
for each branch of the network and one column for each independent 
node-pair (each branch of the tree on the network). If we were able 
to open the m branches of the cotree without interrupting the mesh 
currents flowing through them, we should create m new node-pairs 
and thus be able to augment A by adding m columns, thus making 
the matrix square. This can be done by injecting m currents as 
illustrated in Fig. 10.8. 

The p.d. £,,; across the break in the mesh is zero, and the opera- 
tion will not in any way affect the currents and voltages of the net- 
work. 

Thus, the 6 independent node-pair p.d.s will consist of p basic 
node-pair voltages E;; across the branches of the tree plus m node- 
pair voltages E,,; (= 0) in series with the branches of the cotree. 
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The branch p.d.s can be expressed as linear combinations of E, 
and E;, by means of the matrix equation 


rfl VE} -aaoB}aa(E} ar anay 


where the b-by-p compound matrix {i} = A, is identical with the 


node-pair connexion matrix A of eqn. (10.10). 
It is readily verified that A is its own inverse— 


Atal. 4 : . (10.44) 
and also that the determinant of A is 
det (A) = (—1)” 5 : . (10.45) 


Before compiling the mesh-node matrix corresponding to the mesh 
connexion matrix C of eqn. (10.6), let us study the m-by-p submatrix 
L more closely. 

Each row of L corresponds to a branch of the cotree, and each 
column to a branch of the tree on the network. at, 

The elements in row k of L (which are +1, —1 or 0) indicate 
and orient the branches of the tree that combine with link k of the 
cotree to form the kth basic mesh. At the same time, k shows us 
which basic node-pair p.d.s E}; are used, together with E,y, to 
calculate £,. are 

From this it follows that the elements in a column of L indicate 
(with orientation) the basic mesh currents passing through the cor- 
responding branch of the tree. : ’ 

In order to augment the mesh connexion matrix so as to make it 
square, we adopt a technique 
which is the dual of that employed 
to augment A. Instead of opening 
a branch of the cotree by injecting 
the branch current i from an 
admittanceless current generator, 
we short-circuit a branch of the 
ine by Sapiens ¢ pt 2 Hoss an Fic. 10.9. SHORT-cIRCUITING A Basic 
impedanceless source of e.m.f. TS Nopeeiik 
across the branch. No current will : 
flow in the artificial mesh created because the existing p.d. across 
the branch and the applied voltage are equal and opposed, thus 
cancelling each other. The orientation of the mesh current ip; (= 0) 
coincides with that of i;, as shown in Fig. 10.9. 
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Referring to our remarks about the matrix L, we find that the 
branch currents i are given as linear combinations of the basic mesh 
currents 7’,, and the artificial mesh currents i, by means of the 
equation 


={5 THE} -coff}=cfh}=cr cos 


where C,, = 1a is the mesh connexion matrix denoted by C 


in Section 10.2. 
C is its own inverse and is equal to the transpose of A. Thus 


C=CA,=AC=I. ._. (10.47) 
and hence det (C) = det (A) = (—1)™ . - (10.48) 


Substituting the compound forms of A and C from eqns. (10.43) 
and (10.46) in eqn. (10.47), we get 


(CC) (Ayn) = {62} (Ayn) 


ee eka ee es 
= +d a ‘t={o 5 . (10.49) 


The identity C,,,A, = 0, which is implicit in this equation is the 
same as eqn. (10.13). 


Exercise 1. In this exercise we shall prove that it is always possible to choose 
an independent set of meshes in a network in such a way that each mesh current 
passes through at least one branch which is not linked by any other mesh. 
This set of branches forms a cotree on the network. 

Let us consider a branch 4, connecting nodes n, and ng. If b, is linked by more 
than one mesh, we shall reroute all but one (say m,) of the meshes through other 
paths connecting , and m,. This is equivalent, algebraically, to cancelling all 
the non-zero elements in row 5, of the mesh-connexion matrix C by means of 
linear operations with column m,. Such a process does not alter the rank of C, 
and hence the modified meshes will still be independent. 

Repeating this procedure, we can pair off the m independent meshes of the 
network with m of its branches; the remaining 6 — m = p branches must form 
a tree on the network; for, if they did not, would enclose a mesh which 
could be associated with one of its branches. 


Exercise 2. Applying the mesh-node technique to the circuit of Fig. 10.3 
(Exercise 1, Section 10.2), we choose branches 1, 3, 4 as a tree on the network; 
branches 2, 5, 6, then, are the links. In order to conform to the canonical 
method, branches 1, 3, 4, 2, 5, 6 are renumbered 1’, 2’, 3’, 4’, 5’, 6”. 
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This results in an orthogonal mesh matrix— 
-1 


1 
0 
1 
CY) 
0 
1 


a 
I 
coooo- 
cooroo 
| 
_ 
onrorro 


-1 0 
0 =1 
0 0 = 


The reader should verify by direct multiplication that C,A = I. 
Branch and mesh e.m.f.s are linked by the matrix equation 


vate eS des) 


If we write this expression out in full, it can be seen that the artificial e.m.f.s 
applied across the branches of the tree do not appear in the expanded formula. 
They are in reality unknown response quantities, and not, like the real branch 
e.m.f.s e;, independent variables, - x 

An identity analogous to eqn. (10.11) is also valid— 


=A! . ; 6 - « (10.51) 
All these relations between the network variables and the connexion matrices 
are summarized in Table 10.2. 
Table 10.2 
ORTHOGONAL RELATIONS BETWEEN NETWORK VARIABLES 
E= AE’ E’=CE 


i= Ci’ v=Ad 

Vr=Al I=cr’ 

e=Ce e= Ae’ 
A.C =CA,=1 


Exercise 3. To make sure that the orthogonal transformations of the net- 
work variables leave the total dissipated power invariant, we compute the 
instantaneous power dissipated in the branch immittances— 


P=VJ=(E,+e)Xl +) =EI+Ei+el+ed 
= EXA,CI’ + E/A,Ci’ + e[A,CI’ + e(A,Ci’ 
=(Ej+epl+iy=Po  .  . .  . (10.52) 


To derive the network equations for a network in the orthogonal manner, we 
start as before (see eqn. (10.14)) with Ohm's law— 


E+e=ZI+i) . 4 ‘ + (10.53) 


128 LINEAR NETWORK ANALYSIS 


Pre-multiplication by C, and the insertion of the factor CC = I between Z and 
I + i gives us (with the help of the identities in Table 10.2) 


Pte=Czer+t). 2 .  . 4054 
and V+ =AYAE' +e). . .  . (10.55) 
Here (A, YA)“ = C,ZC, since 
(ALYA)(C,ZC) = A,Y(AC)ZC = A(YZ)C = A,C =I (Q.E.D.) 


To be more explicit, we can write C,ZC and A,YA as follows— 


one = {Ce resi cal a ) 
5 AA = {RVR here «  « #057) 


Comparison of eqn. (10.56) with eqn. (10.15), and of eqn. (10.57) with eqn. 
(10.22), will convince us that the bottom right-hand matrix element of eqn. (10.56) 
is the mesh impedance matrix, and the top left-hand matrix element of eqn. (10.57), 
the node-pair admittance matrix of the network. 


Exercise 4. The mesh-node connexion matrices developed and discussed 
in this section were shown to have determinants equal to (—1)". It is not neces- 
sary, however, to employ basic node-pairs and meshes in order to obtain square 
non-singular connexion matrices. If we compute a mesh-node connexion matrix 
in any other way, its columns (rows) will be independent linear combinations 
of the columns (rows) of the basic matrix. Hence, we can state as a general 
theorem that the determinant of a mesh-node connexion matrix must be equal 
to either +1 or —1. 


To conclude this chapter we shall define and briefly discuss the 
duality of planar networks. 

A planar network is one whose graph can be drawn on a plane 
(or on the surface of a sphere) without any of the branches crossing 
each other. From a purely geometric point of view a planar graph 
can be considered as a complex of nodes, branches and faces. 
Each face is bounded by a set of branches forming a mesh, and each 
branch is bound by a set of (two) nodes forming a node-pair. These 
entities are conveniently ordered in a sequence— 


Node—Node-pair—Branch—Mesh—Face 


which is symmetric about its middle term. 
We can exploit this symmetry to establish a relationship, termed 
topological duality, between planar networks such that— 


(i) Each node in one network corresponds to a face in the other, 
and vice versa. 


(ii) Each branch in one network corresponds to a branch in 
the other. 
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(iii) The branches connected to a node in one network correspond 
to the branches bounding a face (i.e. forming a mesh) in the other, 
and vice versa. 


The diagram in Fig. 10.7 can be enlarged by adding a dot repre- 
senting “‘node” to the left of the dot marked “node-pair,” and a 
dot marked “‘face” at the extreme right of the diagram. This 
modified diagram suggests that the duality relationship is represented 
by the symmetry of the algebraic diagram. It also gives a hint as to 
further properties of networks. First, that a non-planar network in 
which certain of the meshes do not bound a face, and where the 
diagram consequently loses its symmetry, does not possess topological 
duals. Secondly, that because neither a face nor a single node has 
any electrical significance, the diagram of Fig. 10.7 will be symmetric 
even for non-planar networks, and a network therefore always has 
an electrical, if not a topoplogical, dual. 

We shall now proceed to formulate and prove a relationship 
between the trees and cotrees of dual networks. 


Theorem 42. The dual of a tree on a planar network is a cotree 
on the dual network, and vice versa. 

Proof. Let N, and N, be two planar, connected, dually related 
networks. A tree 7, on N, is, by definition, a graph connecting all 
the n, nodes of N, without forming any meshes. 7}, therefore, does 
not divide the plane into disjoint regions, and any two points of the 
plane can be connected without having to cross a branch of 7;. 

The meshes of N, are now so chosen that each mesh encloses a 
face. A mesh of this type is called a window mesh or merely a window. 
The enveloping mesh, which is a linear combination of the indepen- 
dent meshes of the network, can be said to enclose the region lying 
outside it. This terminology becomes far less paradoxical if we think 
of a planar network drawn on the surface of a sphere. If N, has m, 
independent meshes, we can plot ny = m, + | nodes in the plane, 
each node corresponding to a mesh of Nj (including the enveloping 
mesh). 

Each of the nodes of Ng is thus enclosed by a mesh of N, which 
contains at least one branch of the cotree Tj on N,. Also, the 
nN, = m, + 1 nodes of N, can be connected by branches which do 
not intersect 7,, and the graph formed in this way cannot contain 
any closed loops; for, if it did, the loop would enclose a node of 
Nj, which would not, therefore, form part of T,, thus contradicting 
our hypothesis that 7, is a tree on Ny. 

The graph comprising p, = ny — 1 = my, branches connecting all ny 
nodes of N2, without forming any loop, is therefore a tree T, on Ng. 
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To complete the proof, we can pursue an analogous train of 
reasoning to show that the dual of the cotree Tz; on Ng is a tree 
T, on Nj. : 


In view of this theorem, it is to be expected that there must exist a 
close relation between the basic connexion matrices of two dually 
related planar networks. This relationship is given in the next 
theorem. Before stating the theorem, however, we must decide on 
a system of defining the relative orientation of the branches of two 
planar, dual networks. 

We shall adopt the following procedure: After orienting the 
branches of (say) network N, arbi- 


NEEWOLESIN; trarily, we orient a branch 5, form- 
ing part of a window mesh m, of Ng 
in a clockwise or an anti-clockwise 

A direction round m,, according to 


, Whether the image 4, of by is directed 
M14 7 towards or away from the node 7, of 
N, which is the image of mesh mz. 


An interchange of the terms 
clockwise and anti-clockwise results 
Network Nz in a reversal of orientation of all 

the branches of N,, an operation 
which leaves the connexion ma- 
trices invariant. 

5" Once the branches of the two 
cl rie networks have been given an orien- 
tation, the orientations of the in- 
jected currents and voltages and of 
Oe ey re ae the basic mesh currents and node- 
Fic. 10.10. GRrapus or Dua pair voltages are determined by the 
PLANAR NETWORKS polarity conventions indicated in 

Figs. 10.8 and 10.9. 

As an example of the method described above, take node D’ of 
network N,, Fig. 10.10. Of the three branches connected to D’, 
branch 5’ converges, whereas branches 6’ and 7’ diverge. Hence, 
in Nz, where branches 5”, 6” and 7” complete mesh D’, branch 5” 
is oriented in a clockwise, branches and 6” and 7” are oriented in an 
anti-clockwise, direction round the mesh. 


Theorem 43. The basic node-pair connexion matrix of a network 
is equal to the negative of the cotranspose of the basic mesh con- 
nexion matrix of its dual, where the operation cotransposition 
denotes transposition about the second diagonal. 
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The proof follows readily from Theorem 42 when we recall that 
the duality relation maps branches converging on a node into branches 
forming a mesh, a tree into a cotree, and vice versa, and compare 
this with the significance of the rows and columns of the basic 
connexion matrices (see the discussion of submatrix L of the basic 
node-pair connexion matrix A, at the beginning of this section). 

The operation of cotransposition, which is equivalent to renumber- 
ing the branches in reverse order, is necessary so as to place the 
branches of the tree of the dual network in the correct position in 
the basic connexion matrix, as required by our canonical method 
of analysis. 


Exercise 5. Fig. 10.10 illustrates the concept of duality between two planar 
networks N, and Nj. To emphasize the symmetry of the relationship, the charac- 
teristic constants (number of branches, number of independent meshes, etc.) of 
the two networks are given below in tabular form— 


M Ny 


b= 7= by 

HE l=s% 
A=m—5=3=m 

m, = 4= my — Sy = Py 


Note how the branches converging on a node in one network (say 3’, 4’, 6’ of Ny) 
correspond to branches forming a mesh (3”, 4”, 6” of Ng) in the other network, 
and vice versa. 

We can thus Sc ie N, on Ng in such a way that node A’ will lie in 
mesh A”, node B’ in mesh B’, and so forth. Mesh Q’ will then enclose node Q”, 
etc. 

The branches 1’, 4’ and 5’ form a tree on N,. Hence, by Theorem 42, the 
branches 2”, 3”, 6” and 7” of N, must form a tree on Ng. This is readily verified. 


Exercise 6. If we choose branches 1’, 4’ and 5’ as a tree on N, of Exercise 5, 
the mesh-node connexion matrix A’ of N, becomes 


i tdine Sn Diet atone ate 
+ 1 PO. et TO 
4] 0 1 | A, A OE Tee! 
scl wo oS 1 ae: ge ans 
A’=2' 1 0 #60 -1 0 O O-=C, 
3 \-1 1 0 #60 C-!1 od 
6 | 0 1 -l 0 #O =1 0 
ri 1 0-1 2.0 0 —J 


Notice how the rows of A’ indicate (with sign) the branch p.d.s of the covering 
tree that combine to give the p.d. across the branch in question. Branch 4’, 
for example, being part of the tree on Nj, requires only one coordinate E},. 
The p.d. across branch 6’, on the other hand, is a linear combination of the volt- 
ages Ej4, Ej5 and Ems (= 0). 
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Turning our attention to the mesh axes of the network, it is readily seen by 
inspection that the rows of C’ (which are the same as the columns of A’, since 
C’ = Aj) indicate (with orientation) the meshes linking each branch. Each 
branch of the cotree (say 2’) carries only one basic mesh current ((,2), whereas 
a branch of the tree (say 5’) may carry one or more basic mesh currents (ing 
and i;,7) in addition to its own artificial mesh current (if; = 0). 

According to Theorem 43 the basic node-pair connexion matrix of Nz is equal 
to the negative of the cotranspose of A’. 


Hence, 

he NGS BP QP Se! tae ae 

ad 1 0 0 0 0 0 0 

6” 0 1 0 0 0 0 0 

ay tO” OD ee OY Oe: ORG 

A” = —A,. = 2’ 0 0 0 1 0 0 0 

mie 1 1 0 0-1 0 0 

4°} 0-1 -1 #O O -1 0 

1” {-1 0 1 =I 0 0 -!1 


as can readily be verified. 


Exercise 7. If cotransposition is indicated by a subscript k, show that 


(AB), = BA, - . . ° : sala) 
(Ade = (Ar) (= Au: = Ax) - . . fi 
(A), = (Ay? = Ay? . . : 4 « ii) 
det (A,) = det (A) . . a: ; A « (iv) 


In other words, prove that cotransposition follows the same rules as transposi- 
tion and that the two operations commute; also, show that cotransposition and 
inversion commute, and that the determinant of a matrix is invariant to cotrans- 
position. 


PROBLEMS 


10.1. Let a network with four nodes, A, B, C and D, be given. The network 
comprises five branches, AB, BC, AC, CD and AD. Employ Euler's theorem 
(Theorem 41) to determine the number of independent meshes in the network. 

Are the meshes ABC, ACD and ABCD independent? Orient these meshes, 
and express the branch currents as linear combinations of the mesh currents by 
means of a 5-by-3 connexion matrix C. Determine the rank of C. 


10.2. Draw a tree on each of the following networks: (i) a Wheatstone bridge, 
(ii) a network consisting of five branches in parallel, (iii) a network consisting 
of five branches connected in series to form one mesh, (iv) a network consisting 
of six branches connected in star. 


10.3. Show that, if eqn. (10.7) is written P = e,i = e’,i’, we arrive at the same 
equation as before for e’ in terms of e. 

10.4. Draw graphs of all the networks that can be constructed from three 
branches, and write down in each case the corresponding orthogonal connexion 
matrices. 

10.5. Prove by direct matrix multiplication that expressions (10.56) and (10.57) 
are the inverses of each other. Hint. Employ the identities CA, = AC, = C,A = 
A,C =I, where A = (A,A,,) and C = (C,C,,). 
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10.6. Draw the graph of any planar network (N,) and construct the graph of 
its dual (Nz). Choose a tree 7, on N,, and show that the dual of 7, is a cotree, 
Tz on Np. 


10.7. Compile the basic node-pair matrices A, and A, of N, and Nz respec- 
tively (see Problem 10.6), and test the validity of Theorem 43, which requires 
that Ag = —(A);- 


10.8. Calculate the node-pair connexion matrix of a network which is a tree 
on itself (an all-node-pair network). What is the dual of such a network, and 
what is its basic node-pair connexion matrix? 

10.9 Prove that A, = (UAU), = UA,U, where U = (U,,. . . U,U)). 


10.10. Prove that det (U) = (—1)#""-), where U is the square matrix defined 
in Problem 10.9, Prove that U* =I. Use these results to prove the statements 
made in Exercise 7, Section 10.6. 


10.11. Compile the mesh connexion matrix and the node-pair connexion 
matrix of the network shown in Fig. 10.11. 


Fic. 10.11 


10.12. Supply a detailed proof of eqn. (10.9) by expanding the branch 
currents in terms of their mesh current components and then factorizing the 
mesh currents, 


10.13. Prove eqn. (10.11), I’ = A¢I, by requiring that the total power P = I.E 
fed to a network be invariant to a change from a branch to a node-pair point of 
view. 

10.14. Verify eqns. (10.43) and (10.46) in detail. Note in particular how the 
choice of orientation of E;,; and ij; leads to the submatrix —I in the connexion 


matrices A and C, and how this, in turn, ensures that the simple canonical eqns. 
(10.44) and (10.47) are valid. 


10.15. Discuss how, in a planar, connected network, the enveloping mesh is 
dually equivalent to the redundant node (which can be earthed). 

10.16. Draw a number of oriented pls, compile the connexion matrices 
in each case, and verify by inspection the functions of C, and A, as pre-factors 
(see Table 10.1). 


10.17. Let a bridge network such as the one in Fig. 10.3 be given and let the 
conductances of the branches be as follows— 
Branch. . . . 7 o 2 3 4 5 6 
Conductance (mhos) . ‘s Fi | 2 1 ‘| ) 4 


Calculate the node-pair admittance matrix Y’ assuming that no couplings 
exist between the branches. 
6—(T.1046) 
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Suppose now that the following currents are injected at the nodes of the 
network— 
Node . . : . . 0 1 2 3 


Current, I; (amperes) . . -l 2 3 -4 


Is this system of injected currents physically realizable? 

Express the injected currents in terms of three independent sets of currents 
+J, and —IJ, (i = 1, 2, 3) across the independent node-pairs that were used to 
compile the connexion matrix A (see Exercise 1, Section 10.2). 

Calculate the p.d.s £; appearing across the branches of the network. 


CHAPTER 11 
Diakoptics 


11.1, Introduction 


OF all the matrix operations defined in this book, that of inverting 
a square non-singular matrix is by far the most laborious. Any new 
technique, such as diakoptics, designed to facilitate this process is 
therefore worthy of careful consideration. 

In the preceding chapter we have shown that the solution of a 
linear network problem requires inter alia the inversion of an m-by-m 
matrix when the network is analysed as a mesh network, and a 
p-by-p matrix when the node-pair method is employed. 

The amount of labour required to invert a matrix increases roughly 
with the third power of its dimensions so that, even when an auto- 
matic computer is available, the task rapidly becomes prohibitively 
time-consuming, quite apart from the fact that there is a limit to 
the size of the matrices which any given computer can invert. 

Kron’s method of diakoptics, or tearing, greatly reduces the di- 
mensions of the matrices to be inverted by dividing the system into a 
number of smaller subsystems. Each subsystem is then solved as 
an independent entity, and the solutions obtained are combined to 
form the required solution of the total system. In order to inter- 
connect the partial solutions it is necessary to invert an additional 
tie matrix (intersection matrix), but in spite of this, the net result is 
a considerable reduction in the total amount of computational 
labour, not to mention that the diakoptic technique can bring a 
problem within the range of an available computer which might 
otherwise have been incapable of handling the problem at all. 

A rough calculation will illustrate the saving in time. Let the time 
required to invert an N-by-N matrix be T = kKN°, and let us assume 
that the network can be divided into n subsystems of approximately 
equal size. Then each subsystem will be represented by an N/n-by- 
Njn matrix and the total time required to solve the system dia- 
koptically will be of the order of 


Ty = 2kn(N[n)> = T/Qn*) 


where a safety factor of 2 has been included to taken into account 
the additional labour required for the division into subsystems and 
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the inversion of the tie impedance matrix, and for the computation 
of various additional products. As can be seen from this formula, 
even a division into two or three parts will yield an appreciable 
reduction in labour. 

According to Kron’s system of tearing, the division of a given 
network is performed by detaching suitable tie branches so as to 
create a number of unconnected subnetworks. To compensate for 
the branches removed by this process, currents equal to those that 
were flowing through the branches are injected at the nodes from 
which they were disconnected. This method, based on the node-pair 
approach, is called diakoptics. 

The dual method achieves the same division by applying short- 
circuits. This method, described by Onodera, has been given the 
name codiakoptics. We shall, however, confine ourselves to dia- 
koptic analysis. 

As a necessary preliminary, we shall study the mesh impedance 
matrix and the node-pair admittance matrix of a network in greater 
detail. 

Assuming a given network to be energized solely by series sources 
of e.m.f., e, the mesh equation of the circuit is 


e =C,ZCi' = Zi’ ; s + (1.1) 


In addition, we make the assumption that no couplings exist 
between the branches of the network. The primitive impedance 
matrix of the network is therefore diagonal with the general element 


= when i Aj 
746 140 wheni=/ 


Also, the general element of C is 


cy when branch i and mesh j are positively/ 


{= 0 when branch i and mesh j are not incident 
i = +1 
negatively incident 


The mesh impedance matrix Z’ can be written 
Saez, (401... Bb). . (11.2) 


from which we deduce that z/; is equal to the sum of the impedances 
common to meshes i and j, each impedance being multiplied by +1, 
depending on whether mesh i and mesh j are positively or negatively 
incident. Note that the orientation of an individual branch has no 
effect on the sign of the elements of the relevant rows and columns 
of Z’. 
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A mesh can be considered to be positively incident to itself, and 
thus element z;, is the sum of the impedances round mesh k. 

Because this method of writing down the mesh impedance matrix 
for a network without inter-branch couplings is so familiar, we have 
handled its proof rather superficially. The dual method of compiling 
the node-pair matrix of a network by inspection is not universally 
known, and we shall proceed with more circumspection. 

To make our derivation more convincing, we shall base our 
arguments directly on the network without invoking the matrix 
formulae of Section 10.4. Consider, therefore, a node n, of the 
network, and let the injected current at m, be Ij, as shown in Fig. 11.1. 


Fic. 11.1. ComputinG THE NoDE-PAIR MATRIX BY INSPECTION 


The admittances connected to m, are yy, . - ., V4, and the poten- 
tials of m,. . ., m, relative to some reference node are Ej,. . ., Ey. 
It follows from Ohm’s law that 


K=(Ai-— Eye t..-+(— Edy 
= (at. - + dEt — Yinka +--+ —YreEa (11.3) 


This equation enables us to write down Y’ by inspection according 
to the following rules— 


(i) The diagonal element in position kk of Y' is equal to the sum 
of the admittances of the branches converging on node k. 

(ii) The element in position km (k ¢ m) is equal to the negative 
of the admittance jm (= Ym) joining nodes k and m. 


For the subsequent development of the theory of diakoptics, it is 
of vital importance to note carefully what happens to Y’ if the branch 
connecting nodes & and m is removed. 

This change will affect the elements in positions kk, km, mm and 
mk as follows: The elements yj. and Yim will both be reduced by 
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the amount ;», = Ym and the elements y;,,, and y,,, in positions 
km and mk will be deleted. 

To conclude this section, we give in Table 11.1 a list of symbols 
and nomenclature to be employed subsequently. 


Table 11.1 
NOTATION AND NOMENCLATURE 


Symbol Name and Definition 


(system) admittance matrix = primitive admittance matrix of the 


¥ network to be analysed by diakoptics. 

ae: (system) node-pair admittance matrix (defined in Section 10.4). 
(system) torn admittance matrix = node-pair admittance matrix of 

Lig the unconnected network that remains when the tie branches are 


removed. 


Z(= Y’-")_| torn impedance matrix. 


x= y) tie impedance matrix = diagonal matrix containing all the tie 
branch impedances. 


tie connexion matrix = matrix indicating how the tie branches are 


K connected to the nodes of the original network. 


11.2. Division of Network into Subnetworks 


In this section we shall discuss what happens to the node-pair 
matrix Y’ of a large system when a number of branches are removed 


Subnetwork 3 
Fic. 11.2. Division oF NeTwoRK INTO SUBNETWORKS 


so as to divide the network into a number of uncoupled subnet- 
works. 

We shall assume that the non-torn network is connected and that 
the p independent node potentials are measured relative to some 
datum’ node which is common to all the subnetworks. Kron calls 
such a network a diffusion-type network. 
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The tie immittances, typified by the impedance z,; (= 1/y,,), are 
assumed to have no magnetic couplings with any of the subnetworks 
{ee ae 

The p-by-p node-pair matrix Y’ is now partitioned in accordance 
with the division of the network as follows— 


{ie Yia x.) 

XY = You Yoo Yo 

Yn Yoo Ygs 

All the submatrices along the main matrix diagonal are square, and 
their off-diagonal elements depend only on the corresponding sub- 
network. 

The elements of the non-diagonal submatrices Yj; (i + j) consist 
of the tie admittances connecting the nodes of subnetworks i and j. 
When one or more of the subnetworks contain active devices such 
as vacuum tubes, the corresponding matrices on the main matrix 
diagonal of Y’ will be non-symmetric, but, because of our choice of 
ties, the remaining portion of Y’ will be symmetric, i.e. ¥/, = (Y/,), 
G4). 

If we now remove all the tie admittances, Y’ will be transformed 
into Y” according to the pattern outlined in the previous section: 
all the submatrices not on the main matrix diagonal vanish, and all 
the elements of row (or column) i which do not belong to the main 
matrix diagonal are added to the elements in position ii. 

To compensate for the removal of the tie branch connecting nodes 
i and j and oriented from (say) i to j, we inject currents —J” and 
+I” at nodes i and j, respectively, where /” is equal to the current 
flowing in the branch connecting node i with node j. 

These injected currents are added to the externally injected currents, 
I; and Jj. In order to do so, we compile a p-by-r tie connexion 
matrix K (where r is the number of tie branches) with a row for 
each tie branch. In column q of K, +1 will appear in the row 
corresponding to the node where +// is injected, and —1 in the 
row of the node at which —/7 is applied. 


r columns 
Fi cg emt aed he | 
K=;- - > ++ prows 
+1 ./7 
q 
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Thus the matrix product KI” orders the 2r tie branch currents 
according to the nodes at which they are injected. The augmented 
set of injected currents of the torn network, arranged in the usual 
way as a p-dimensional vector, is 


Terk s,s, CLA) 


where I’ represents the original injected node-pair currents, and the 
r-dimensional vector I" represents the currents that are injected to 
compensate for the removal of the tie branches. 

From the manner in which K was defined, each of its columns 
indicates and orients the nodes forming the terminals of a tie branch. 
It is readily seen that the p.d.s across the r tie branches can be ex- 
pressed as —K,E’ when the orientation of currents and voltage drops 
is chosen in accordance with the polarity convention given in Fig. 10.1, 
p- 112. 

Finally, arranging the r tie impedances z,, along the main diagonal 
of an r-by-r matrix z, we have 


eee Leo Some el as) 


11.3. Inversion of Node-Pair Matrix Y’ 


It was shown in the previous section how the removal of the tie 
immittances was compensated for by injecting a set of currents KI” 
at the node pairs of the torn network in addition to the set I’ which 
were present in the original network. 

The node-pair equation of the torn network is 


'+kr=y’'E. : - (11.6) 

or BE =(¥’)"( + KI’) = Z"(I' + KI’) . - (11.7) 
This equation is not, however, a true solution to the network 
problem, since the node-pair currents I" which appear on its right- 
hand side are in reality branch currents and, as such, unknown 


response quantities. To eliminate I", we utilize eqn. (11.5). Pre- 
multiplication of eqn. (11.7) by K, gives 


KE =K,Z"(l'+KI")=—-zI" . __. (11.8) 
which, solved for I”, yields 
I" = —(2 + K,2'K)7K,z'T 7 «e (1'9) 


Substituting this equation in eqn. (11.7), we find 
EF =Z'0 — K(@z + K,2’K)7K,2'\l' . (11.10) 
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which is a solution to the original network problem 
r=YE . . 5 . (11.11) 
By comparison of eqns. (11.10) and (11.11), it is clear that 
(Y’)7 = Z’ — Z’'K@ + K,Z’K)"K,Z’ » (11.12) 


The main advantage of diakoptics can be read from eqn. (11.10). 
The only matrix inversions to be performed in order to solve 
eqn. (11.11) are 


Vie we 427) 6 14 
0): We nde HO 
y= ‘ fe lay 

OL Oem tem xptyrs 

(Yn) 0 Sore 0 
or Sey oe * 

= ‘ 0 Raa : =Z’ 

0 x -. . (¥ 


which is comparatively simple, and 
(2 + K,Z'K)> 
which is an r-by-r matrix where r < p. 


Exercise 1. In addition to the two above-mentioned inversions, we ma: 
also invert the diagonal r-by-r tie admittance matrix y (2 = y~), although this 
is not strictly necessary. Pre-multiplying the term K,Z’K by zy (= I), we get 

(2 + zyK,Z’K) = (1 + yK,Z’K)"z = (1 + yK,2’K)y 
Similarly, post-multiplication of K,Z"K by yz (= I) will yield 
( + K,Z’K) = yl + K,Z’Ky)> 
neither of which contains z. 


Eqn. (11.12) is so important to the theory of diakoptics that we 
shall derive it once more in another way. 

Consider the product KyK,, where y is the r-by-r diagonal tie 
admittance matrix, and K the p-by-r tie connexion matrix. It will 
be recalled from Section 11.2 that each column of K indicates and 
orients the two nodes between which the corresponding tie branch 
is connected. 
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Take element y,, of y and let us assume that this tie connects 
nodes wu and v of the original network. Ignoring for the time being 
all other elements of y, the product Ky will be 


q 
alk q 
at Se een ate 
bj | ea esl eee Sh 
q 

+Yaq + | 4 


Ye +|? 


Post-multiplication of this expression by K, yields a p-by-p matrix 


u Dv 
+Yea + + Yaa +) % 
KyK, = who eee 
Jag i Meg = | 8 


which has +y,, in positions uu and vv, and —y,, in positions uv 
and vu. 

This result is readily generalized to the case where all the diagonal 
elements of y are non-zero. By comparison with the system outlined 
in Section 11.1 for writing down Y’ directly from inspection, it is 
clear that 

Wie Vi+RyK, «  «  . (iI3) 


Comparing this decomposition of Y’ with eqns. (4.25) and (4.31), 
we again arrive at the expression for the inverse of Y’. 


Exercise 2. Yet another way of deriving eqn. (11.12) can be found by follow- 
ing up a hint given in Section 5.5, where the partitioned inverse of a matrix 
was derived. 

Let a partitioned matrix 


1€ a and its inverse {he xt 


PROBLEMS 143 


be given, where A, D, K and N are square and the submatrices in corresponding 
positions are like. 
Since inverses commute, we have 


ae 4h ta z} 5 . « (11.14) 
Cc DJ |M N ot 
wl eae eS 
Hence, from eqn. (11.14), 
—AL+BN=0O or L=A"BN 4 + (11.16) 
and CL+DN=I. . : . - (11.17) 
Substituting eqn. (11.16) in eqn. (11.17), 
No =D+CA3B , . r + (11.18) 
Egn. (11.15) yields 
KB+LD=0 or L = —KBD"! . + (11,19) 
and —-KA+LC =I 5 fi , - (11.20) 
Eliminating L from eqns, (11.19) and (11.20), we get 
K=-(A+BD"(C) . - i 5 + (11.21) 
and, substituting this equation in eqn. (11.19), 
L=(A+BD"C)"BD" . 4 3 5 - (11.22) 
which, when substituted in eqn. (11.17), yields 
N =D"! —D"'C(A + BD“C)"'BD 5 + (11.23) 


Substituting (Y’)~“' for N, Y” for D, Z” for D~, K for C, K, for B, y for A“, 
and z for A, eqns. (11.18) and (11.23) transform into eqns. (11.13) and (11.12), 
respectively. 

PROBLEMS 

11.1. Verify the statement in Section 11.1 that the orientation of the individual 
branches has no effect on the sign of the elements of the mesh-impedance 
matrix Z’. 

11.2. Compute the node-pair connexion matrix A of the network shown in 
Fig. 11.3. Calculate its node-pair admittance matrix Y’ = A,;YA, and compare 


Fic, 11.3 


the expression with that obtained by the method described in Section 11.1, 
i.e. by inspection. 

11.3. Verify by detailed computation the statement in Exercise 1, Section 11.3, 
to the effect that the expression Y’ = Y” + KyK, is generally valid. 
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11.4. Show that both K,Z’K and KyK, are invariant to any reorientation of 
the tie branches. 

11.5. Write down the primitive admittance matrix Y of the network shown 
in Fig. 11.4 (all the admittances are given in millimhos) and compile the node- 
pair admittance matrix Y’ by means of the formula Y’ = A,YA, and also by 
inspection. 


Fic. 11.4 


“Tear” the network into two earthed subnetworks by. removing branches 
ny — ng and m, — ny, and calculate the torn admittance matrix Y”. Write down 
the tie connexion matrix K, and the tie impedance matrix z. Calculate (Y’)* 
by means of eqn. (11.12), and check the result by calculating (Y’)(¥’)"*. 


CHAPTER 12 


Tensor Analysis 


12.1, Introduction—Non-Linear Coordinate Transformations 


It is customary for the author of a textbook to write a preface in 
which he apologizes for “adding yet another book to the already 
extensive literature on the subject.” He then goes on to explain 
why he considers the publication of his work to be justified, and points 
to a novel method of exposition or some other feature in order to 
prove his contention. 

Having thus excused himself, thanked his colleagues and his pub- 
lishers, and prepared his reader for what is to follow, the author 
proceeds to present his subject only to come to an abrupt stop at 
the end of the final chapter. Since even the largest textbook cannot 
hope to explore fully all the aspects of any given subject, this sudden 
conclusion leaves the reader suspended in mid-air not knowing what 
to do next. To match his polite introduction it would be fitting if 
the author were to take his leave by pointing out some of the things 
which lack of space had compelled him to ignore, and to suggest a 
further course of study for those interested readers who might desire 
to learn more about the subject. 

It was mentioned in Chapter 1 that we would endeavour to present 
the theory of matrices so as to prepare the way for the theory of 
tensors. It would therefore be natural to conclude the book with 
a brief account of the elements of tensor analysis. The present 
chapter should thus be viewed, not as an introduction to tensor, 
calculus, but rather as an appendix to a book on matrices which 
points to the path any student must follow if he wishes to penetrate 
deeper into the world of the geometrized physical sciences, where 
matrix algebra, tensor analysis, group theory and topology combine 
with physics and engineering to form a higher unity. 

A variable point P in n-dimensional space (V,) is expressed in a 
coordinate system S, by a set of ordered variables x‘ (i = 1,. . ., ). 
Relative to some other system S,, the same point P is given by another 
set of variables y‘. The coordinate transformation from S, to S, 
is said to be admissible in a region R, if the y' = y‘(x’) are differen- 
tiable single-valued functions of the x’ such that the Jacobian 
determinant det (@y‘/éx’) 4 0 in R. 
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An admissible transformation is invertible, the x’ being differen- 
tiable single-valued. functions of the y‘, and the corresponding 
Jacobian is : 

det (@x//ay’) = Ifdet (@y'/éx*) @j=l....”) (12.1) 

Also, since both sets of variables are independent, we have 

oxt — dy? F 1 when i =/ 
Fain Byhwton Owheni¥jJ ~ ns} 

The symbol 6! is the Kronecker delta, which, written as a matrix, 
is identical with I. 

Applying a second transformation from S, to S,, we have 
z* = z*(yi(x‘)), and hence, employing Einstein’s summation con- 
vention, 


az* dz* ay 
lat . (12.3) 
When S, = S,, and therefore x‘ = z‘, this equation becomes 
ax* ax* dy! 
RTO TS Be . (12.4) 


It is obvious from the above equations that the set of partial 
derivatives corresponding to a set of admissible transformations 
form a group. The consecutive application of two admissible co- 
ordinate transformations is itself an admissible transformation (the 
combination of derivatives being given by eqn. (12.3); the identity 
transformation exists (with derivatives equal to the Kronecker delta); 
and every admissible transformation possesses an inverse transfor- 
mation which is also admissible (the relevant derivatives being 
reciprocally related as shown in eqn. (12.4)). 

When the y! are linear homogeneous independent functions of 
the x’, we have 


yt = ajx? : P 7 . (12.5) 
and hence 
dyifoxi=ay . ‘ - (12.6) 
where det (a!) 40. Compare these expressions with eqn. (6.5), 
p- 60. 


An infinitesimal displacement of P is given as dx‘ in S,, and dy* 
in S,. The relation between the two differentials is found by differ- 
entiating the function y' = y‘(x’). This yields 


éy* 
df = 35.0 . ENS 0557) 
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To introduce the idea of distance into our space we define a 
quadratic form (a metric) Fi 


ds? = ,g,,dx‘dx' . : : . (12.8) 


where dx‘ is the displacement of P, and ,g;,, which is symmetric in 
i and j (see Exercise 1, Section 6.1), is the metric (or fundamental) 
tensor of our space referred to S,,. 

Assuming distance to be invariant to coordinate transformations, 
we find, by using eqn. (12.7), 


Ox! axi 
d? = 8 Fy ee dy*dy’ = ,g,y"dy* . . (12.9) 


from which we deduce that the metric tensor transforms according 
to the formula 
ax* ax) 
vrs = ay . Bye ais ; F - (12.10) 


12.2. Co- and Contrayariant Tensors 


A set of n functions ,a‘ of the n variables x‘ are said to be the com- 
ponents of a contravariant monovalent tensor (contravariant vector) 
referred to the coordinate system S,, if they transform according 
to the formula 


weet. ee. GziD 


when we apply a transformation belonging to a group of admissible 
coordinate transformations. 
Analogously, a set of functions ,a; transforming according to 
the pattern 
x0 
As = Fei as 6 : i - (12.12) 


are the components in S, of a covariant vector (monovalent covariant 
tensor). 

Except in the case of Euclidean space referred to rectilinear co- 
ordinates, the coordinates themselves are not tensors (in spite 
of the fact that they are indicated by means of a kernel letter and a 
superscript). 

From eqn. (12.7) it appears, however, that the dx‘ are the com- 
ponents of a contravariant vector. 
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A simple example of a covariant vector can be found in the 
gradient of a scalar field V = V(x"). When transforming grad V 
from S, to S,, we have 

eV dx) av 
Bi ae oe + (12.13) 
which is functionally identical with eqn. (12.12). 

With the above equations of definition in mind, we now go on to 
define tensors of higher valence. The fundamental tensor, g,,, which 
was introduced to metrize our space, is an example of a divalent 
covariant tensor with the transformation formulae given in eqn. 
(12.10) (see also Exercise 1, Section 6.1). 

Similarly, a divalent contravariant tensor a” will obey the trans- 
formation equation 


. (12.14) 


A tensor with one contravariant and one covariant index is called 
a divalent mixed tensor. It transforms as follows— 


dy* dx*® 
=e Bi guile? wv hy G25) 


The Kronecker delta is an instance of such a mixed divalent 
tensor— 


ay’ ax ay! ax ay 
H Se OR SS SE = i 
i= oy ay &= ae By = dys = a ~=—-: (12.16) 


We have shown in Section 6.1, p. 60, that the distinction between 
co- and contravariance disappears when we confine ourselves to 
the group of orthonormal transformations. This result also applies 
to tensors but will not be proved here. 


Note 1. To acquaint himself with the mechanism of indicial notation, the 
reader merely has to compare the various transformation formulae given up 
to now. By convention, the dx‘ are termed contravariant, and superior and 
inferior indices have been chosen to denote contravariance and covariance 
respectively. 

In tensor formulae the live or free (i.e. non-dummy) indices of the two members 
of an equation “check”, the same index appearing in the same position on both 
sides of the equality sign. Also, it will be noted that we always sum over a pair 
of contragredient indices; we shall see later (Section 12.3) that this is necessary 
if we wish to preserve the tensor character of our expressions. 

Different tensors are indicated by different kernel letters, and to remind us of 
the coordinate system to which a particular tensor is referred, we use an inferior 
prefix. 
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It will be noted from eqn. (12.13) that differentiation with respect to a con- 
travariant variable results in an additional covariant index. 

The reader must reconcile himself with the fact that it takes some time to get 
used to the kernel-index notation. With a little practice, however, he will dis- 
cover its advantages and find out for himself what a powerful mnemonic aid 
the positioning of indices can be. 


Exercise 1. If we define a divalent covariant tensor which is identical to the 
Kronecker delta in (say) S,, 
Oy = 295 


we can investigate how its coordinates transform when we pass from S, to S,. 
We find that 
Ox" Ox* Ox? ax? 
Os = Bi Dyi are = Dea" By Fo 
which proves that 0,, is no longer a Kronecker delta. As an illustration of this 
consider the metric tensor of a 2-dimensional space. Referred to Cartesian 
coordinates, it is represented by the 2-by-2 unit matrix, whereas in polar coordin- 
ates (r, 0) it changes into 
10 
{o 


Exercise 2. We shall now test whether the property of symmetry of a divalent 
contravariant tensor a” is invariant to coordinate transformations. 
By hypothesis, ,a = ,@", and from eqn. (12.14) we get 


dy! 2 dy 2 
ye OY OY ML i alee 
va Dr Da = Ber” Ba = vel 

which shows that the symmetry of a” is not destroyed by transformation. 
Symmetry is also preserved in a covariant divalent tensor, but the proof breaks 
down for a mixed divalent tensor which happens to be symmetric with respect 
to its contragredient indices in a specific coordinate system. 


The transformation equations given in this section can easily be 
generalized to cater for tensors of higher valence than two. For 
instance, a‘, is a trivalent tensor, contravariant in one index and 
covariant in two. Its equation of transformation is 


vs = yi" Dy" Axl” e 


Note 2. In any given coordinate system the components of a tensor can be 
written in the form of a matrix (in the case of tensors of valence higher than 2 
a “matrix of matrices” will be required). It should be clearly understood that 
a matrix as such is not a tensor. A matrix can be given the name fensor only 
when the underlying transformation group and the equation of transformation 
are known. 

It is quite possible for a set of functions to be the components of a tensor 
under one group of transformations but not under another more general group. 

Hence, only the orthogonal form of the matrix equations of an electrical 
network can be said to be tensor equations, the associated group being the 
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connexion group, the elements of which are the square mesh-node connexion 
matrices corresponding to all the networks that can be built from the given 
number of branches. 


12.3. Tensor Algebra 

We can easily convince ourselves, by reference to the defining 
equations of the previous section, that any linear combination of 
tensors of the same type is a tensor of the same type, provided that 
the constants appearing as coefficients are invariant to the relevant 
group of transformations. An important property of tensors im- 
plicit in this statement is that, if a tensor vanishes in one coordinate 
system, it will vanish in all other coordinate systems of the under- 
lying group. 

From two arbitrary tensors we can form another tensor, the outer 
product, whose valence is the sum of those of its constituent factors 
(see Section 5.1, p. 51). Thus, for instance, 


en 
Pim = Chem 


Also, from a mixed tensor of valence N we can form a tensor of 
valence N —2 by contraction, i.e. by summing over a pair of 
contragredient indices. Hence, the mixed trivalent tensor aj’ be- 
comes a contravariant vector when we perform the summation a’. 
Contraction does not alter the tensor character of aj’: from the 
transformation equation 


| ay! ay? axt 
ae 2S of avknlh woaint «Aka 
ay aye ax! 
we get At BS at 
ay! “ao. op 
=a et C= sa ot ; « (12.18) 


which clearly demonstrates that a’ is a contravariant vector. 

The contraction of a tensor with respect to a pair of cogredient 
indices is also possible, but this operation does not yield a tensor—a 
fact which is easily verified. 

Contracting a divalent mixed tensor, we obtain an invariant scalar 
quantity (the trace) (cf. Section 6.7, p. 73). It is thus consistent 
with our terminology to call an invariant a tensor of zero valence. 

We have proved that the outer product of two arbitrary tensors 
is a tensor. Conversely, it can be proved that, if the outer product 
of a set of functions by an arbitrary tensor is a tensor, the set of 
functions are the components of a tensor of the type necessary to 
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balance the equation indicially. This theorem is called the quotient 
law (we shall not prove it here). 

By employing outer multiplication followed by contraction, we 
now introduce a contravariant divalent symmetric tensor g“, the 
contravariant metric tensor, which satisfies the equation 


gugi* =o ue nis sei) 


In any coordinate system g,; and g”” are represented by reciprocal 
matrices. 

Outer multiplication coupled with contraction is termed inner 
multiplication. Inner multiplication of a contravariant vector by 
the covariant tensor results in a covariant vector 


a2,,=4, . 3 , . (12.20) 


This process is called lowering an index. The reverse process of 
raising an index is accomplished by inner multiplication by the con- 
travariant metric tensor g“. 


Exercise. A tensor can be contracted with respect to two cogredient indices, 
but the transformation equation indicates that the result is not a tensor. Thus, 
for instance, 


tlaegs ax! ax' . he ao 
which is not equal to ,a**, because ay : ae is not generally identical with the 


Kronecker delta. 


12.4, The Christoffel Symbols 

In general, the components of the metric tensors are functions of 
the space coordinates. We shall now define two sets of derived 
functions, which, as we shall see, do not form the components of a 
tensor but are nevertheless necessary in order to develop the concepts 
of covariant and intrinsic differentiation. 

The Christoffel symbol of the first kind is defined by the equation 


; lifoei wideale Oe, 
wn 25 |e + Be — Be mee tial) 


The Christoffel symbol of the second kind is defined by 


{femme Fe PTD) 
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In order to obtain the transformation formula of [ij, k], we 
differentiate eqn. (12.10) with respect to y* and find 
Qase _Qabes Ot Bah Oat | Ot Dat Oat at 
Bye Ox! Bye Dy Dy * Bytoye Dy e8ee F Dt” Hoye’ Bre 
. (12.23) 


which shows, incidentally, that 0,¢;,/6y* is not a tensor unless the 
second derivatives vanish identically. 
Permuting the indices in this equation, and using eqn. (12.21), 
we find, after some algebraic manipulation, 
= Ox" Ox* Ox' ) Ox = Px* 
oli, KL = alts, 1 Ba Ba BET BR Byrayi Br (12.24) 


Multiplying the members of this equation by the corresponding 
members of the transformation equation 


se = Bt xe Lo Minn, F « (12.25) 


we arrive at the expression 


n) _ fu |am" Ox dx! | dy" Ox* 
di i -{, | Be Bg Bp + BF Oyo ae 


Eqns. (12.24) and (12.26) clearly indicate that neither of the 
Christoffel symbols is a tensor. 
Inner multiplication of eqn. (12.26) by 0x’/dy” yields the identity 


Gxt = me oxt t ox" ox* ( 12. 27 

ayy = |i Oly slot ae + 1227) 
expressing the second derivative of x‘ with respect to y! in terms of 
the Christoffel symbols and the first derivatives. 


Exercise. From the defining equations it is clear that the Christoffel symbols 
are symmetric with respect to the indices i andj. Hence, by interchanging i and k 
in eqn. (12.21) and adding the resulting equations, we get 

@ 
SR = WF 5 5. 228) 

Note. At first sight one might be tempted to believe that the Christoffel 
symbols, being derived from the fundamental tensor, would also possess tensor 
characteristics. The existence of a second term in their transformation equations 
proves that such a supposition is untrue. This points to the significant fact that 
a tensor equation is invariant in functional form with respect to its associated 
transformation group. 

It follows that if we succeed in expressing a physical relationship as a tensor 
equation, it will acquire the status of a “natural law’ by virtue of its formal 
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invariance. Under the circumstances, we ought to be justified in assuming the 
physical concepts entering into the equation, as well as the “law” itself, to be of 
fundamental importance seeing that they do not depend on the system of coordin- 
ates (within the specified group) to which they are referred. 

Kron’s second generalization postulate states this idea in other words. Observe 
in this connexion the functional identity between the orthogonal network 
equation and Ohm’s law for a simple series circuit containing a source of e.m.f. € 
and an impedance Z: e = Zi. 


12.5. Covariant Differentiation 


Eqn. (12.23) indicated that the derivative of a tensor need not 
itself be a tensor. The question, therefore, naturally arises, Can we 
define a system of differentiation such that the derivative of a tensor 
will still be a tensor? This section will provide an affirmative 
answer. 

Let us begin by differentiating the transformation equation of a 
contravariant vector (eqn. (12.11)) with respect to the variable y*— 

aya! _ dua! ox” ay |, yt xm 
yk — ax" Dyk xi T + Bylo” OF 

Eliminating the second derivative by means of eqn. (12.27), we 
find 


. (12.29) 


i A a RH 
aye = ax Oy ax TBF Lj mf ax 
ee ee 
“4, He a ae. 2 i) 


from which, with the help of eqn. (12.11) and by changing a few 
dummy indices, we derive 


d,at | 6a" ft th) \iieRe Bre 
etal, kf = [ate jm les aay) 
This equation shows that the left-hand member transforms as a 
mixed divalent tensor (note the invariance in functional form). 


The operation, which is indicated by means of a comma, is called 
covariant differentiation. Thus— 


d,at i 
i D ¥ v 
Me = Be +a {, i} 4 . (12.32) 
Under the group of linear transformations, the Christoffel 


symbols vanish identically, and covariant differentiation degenerates 
into ordinary partial differentiation. 
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By a train of reasoning analogous to that employed above, we 
can prove that the following covariant derivative of a covariant 
tensor— 


; ye i 
Min = Fa rare i} sera oraa |=) 
is also a tensor. 


Similarly, a mixed tensor possesses a covariant derivative with 
tensor properties— 


a. i . 
a, 2 i+ fir y - a} {, ; A (12.34) 


This defining equation is readily generalized to tensors of any 
valence and any type. 


Exercise. Applying covariant differentiation to the Kronecker delta 
005 i 
bin = Fa + OF {n ef — mn {;"* 


no fy} {4-0 


we see that the Kronecker delta behaves as a constant with respect to covariant 
differentiation 


& 
Also, Sin = 4 — 8ns 1; *} 7 Sim {j "k 


7 
= 33 - ik - Ue 


=0 by eqn. (12.28) 
Likewise, we can prove that g% = 0. 
, Covariant differentiation adds a covariant index to a tensor thus 
increasing its valence by one. Further, it can be shown that covariant 
differentiation obeys the rules of ordinary differentiation, the 


fundamental tensors and the Kronecker delta behaving like constants. 
Thus, for instance, 


(a' + 5’); = al; + Bf 
(3b) .m = @5,mb* + aibin 
and (34) .= 8°45 
12.6. Intrinsic Differentiation 
Differentiation of a tensor with respect to a scalar parameter ¢ 

can be defined in such a way as to preserve the tensor character of 
the derivative, by means of the following equation— 

6,45 » dx* 

Fae Th Siac tac 8 2)) 
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This derivative, called the intrinsic derivative, is a tensor, since it is 
formed as the inner product of the two tensors aj, and dx*/dt. 
When the Christoffel symbols vanish, the intrinsic derivative 
becomes the ordinary scalar derivative. 
The intrinsic derivative of an invariant is equal to the ordinary 
scalar derivative— 


a 78 ae OS dt at . . (12.36) 


From the results of the Exercise in Section 12.5, it is clear that 
the intrinsic derivatives of the fundamental tensors and of the 
Kronecker delta all vanish identically. 


Exercise. In polar coordinates, the components of the Christoffel symbol 
of the second kind are 
k—> 


k\=fifo OLif 0 ifr 
dey 410 —rf}Ulfr 0 
where we have written the symbol out in full as a 1-by-2 matrix of 2-by-2 matrices. 
The components of a velocity are dx'/dt (i = 1, 2) and dy'/dt (y' = r, y* = 9), 
in Cartesian and polar coordinates respectively. To obtain the components of 
the acceleration, we cannot differentiate the components of the velocity vector 
in the usual way, since this would not generally yield a vector quantity, but must 
resort to intrinsic differentiation. 
In the Cartesian case, the Christoffel symbols vanish and we get d®x‘/dt? as the 
components of the acceleration vector. 
For a polar system, however, we have 


ye eke ee i 
ot \de de dt VWikS dt 
which, after some manipulation, yields the components 
A OE OE 
ae NG) 884 aa te ae at 
(a well-known result). 
To convince himself that these expressions are in fact correct, the reader would 


be well advised to transform the components d*x‘/dt? by means of the transforma- 
tion formula (@y‘/éx!)(d*x'/dt*). 


12.7. Conclusion and Prospect 

And so we come to the end of the book, but not by any means to 
the end of the subject. 

A firm grasp of the essentials of matrix algebra having been 
acquired, the logical step forward is to study the three interconnected 
disciplines: tensor analysis, group theory and algebraic topology. 

This chapter has already given us a brief introduction to tensor 
calculus. We have defined tensors of various types, and generalized 
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the process of differentiation to enable it to take into account, not 
only the change in the coordinates of an object, but also the twisting 
and turning of the coordinates axes themselves, thus preserving the 
functional invariance which is such an important characteristic of 
tensors. 

The immediate goal of the student should be to understand how 
a space is defined by means of its transformation group together 
with its metric tensor. Having metrized our space by defining the 
length of an infinitesimal displacement, our next step is to study the 
idea of the shortest distance between two points. Such geodesic 
problems appear in numerous disguises in many fields of applied 
mathematics, including the theory of electro-mechanical systems. 

From this beginning the concept of curvature follows naturally. 
By means of certain curvature tensors, some of which are tetravalent, 
it becomes possible to detect the curvature of a given space “from 
the inside.” 

A large number of books are available on tensor analysis, those 
by McConnell,‘ Spain‘ and Sokolnikoff providing comprehen- 
sivetreatments which should suffice for most of the technical literature 
employing tensors. For more advanced texts the student may 
consult the books by Schouten." 1 

In attempting a general description of the theory of groups, one 
can do no better than to quote Alice’s remarks after seeing the 
Cheshire cat gradually fade away: “Well! I’ve often seen a cat 
without a grin, but a grin without a cat! It’s the most curious thing 
I ever saw in all my life!” In its most abstract form, the theory 
of groups can well be likened to a grin without a cat: the study of 
the structure of an unspecified relationship between undefined 
elements. 

With the help of the group concept we are able to establish order 
in what might otherwise be an amorphous jungle of facts. We have 
already seen how tensors depend on groups for their definition. 

Many excellent books on the theory of groups are available. 
Probably the one by Ledermann will meet most of the requirements 
of the engineer. 

From the study of networks, electrical engineers acquire a smat- 
tering of topology. In Chapter 10 we made use of topological 
methods and introduced the idea of a tree on a network. A more 
extensive and systematic knowledge of the subject is necessary, 
however, in order to understand many of the articles on network 
theory appearing in technical periodicals today. 

Books such as those by Veblen,” Patterson) and Wallace ® 
provide very clear and readable introductions to the subject, and 
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for the ambitious reader there is the advanced text on the foundations 
of algebraic topology by Eilenberg and Steenrod."* In his book 
on topological groups, Pontrjagin®” includes a lucid, but exception- 
ally concise, summary of both group theory and topology. 

In the field of topology, the theory of groups again offers a helping 
hand in the task of classifying topological relationships. We have 
touched on this aspect in connexion with the algebraic diagram of 
network analysis. A deeper study reveals it to be merely a fragment 
of a larger and much more intricate mosaic. In particular, the homo- 
morphic mapping of one group on another, as well as the idea of : 
homology sequences, is prerequisite to a thorough understanding of 
the structure of Kron’s methods of network analysis.*°,29 

With a solid knowledge of matrix algebra, and a clear grasp of the 
methods and scope of tensor analysis, group theory and algebraic 
topology, an electrical engineer should be adequately equipped to 
appreciate the pattern of his own subject, and to recognize similar 
patterns in other fields of science and engineering. 

Whether we like it or not, the days of the polyhistor, with his 
balanced knowledge of men and books, belong to the past, and we 
are living in an age where, to make his mark, the scientist or engineer 
must needs strive to know more and more about less and less. This 
process of differentiation has been carried to such extremes that 
the specialist is rapidly losing contact with the ramifications of his 
subject. He speaks a specialized language intelligible only to himself 
and a few professional cronies, and he does not know whether the 
work he is doing is not being duplicated in other fields. 

Applied with intelligence and care, the geometric methods to 
which this book serves as an elementary introduction will enable 
the engineer to catch a glimpse of the panorama of contemporary 
science, pure and applied, without obscuring his view of his own field. 


PROBLEMS 
12.1. Calculate x'/éy! and @y'/@x’ for the coordinate transformation 
x! = y! cos y? 
x* = ytsin y® 
from Cartesian to polar coordinates. Is the transformation admissible every- 
where? Show that (dy!, 0) and (0, dy*) are orthogonal. 


12.2. Use eqn. (6.7) to derive the metric given in Exercise 1, Section 12,2— 


10 
sui=jo 


12.3. Verify the statement made in the first paragraph of Section 12.3, namely 
that a tensor which vanishes in one coordinate system will vanish in all other 
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coordinate systems of the underlying group, by discussing the transformation 
of the tensor aj — aj = 0. 


12.4. Is a} — by atensor? Let aj — ,; vanish in S,; will the expression also 
vanish in (say) Sy? 

Note in this connexion the manner in which the Cayley-Hamilton theorem 
was proved: the matrix reduction polynomial was transformed into a coordinate 
system in which it was readily seen to be equal to a zero matrix. Hence, because 
of the invertibility of the transformation matrix M, the theorem was shown to 
be generally valid. 

12.5, Discuss Exercise 2, Section 12.2, from a purely matrix point of view 
(compare the Exercises in Sections 6.4 and 7.2). 

12.6. Calculate Ox‘/ay’, ay//éz" and @x‘/éz*, where the x‘ refer to Cartesian, 
the y’ to cylindrical-polar, and the z* to spherical-polar, coordinate systems. 


12.7. Prove that a,, = @a/0x*, where a is an invariant, by contracting the 
divalent, mixed tensor an over i and j (see eqn. (12.34). 
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Symmetric matrix, 24, 65, 84 
p-DirEcTION (E,), 12 System matrix, 138 
Positive definite form, 84 
Post-factor, 24 Tensor of inertia, 96 
Pre-factor, 24 Tie, 136, 139 
Primitive admittance matrix, 118 Trace (Spur), 73, 150 
Primitive impedance matrix, 116 Transformation— 
Product, inner and outer, 51 linear, 59 

non-linear, 145 

Quapratic form, 82 Transpose, 19, 24 
Quadric surface, 90 Tree, 111 
Quotient law, 151 

Union, 41 
Ratsinc an index, 151 Unit matrix (idemfactor), 24 
Rank, 12, 16 Unit vector (normalized vector), 7, 52 
Reduction polynomial, 68, 72 
Right inverse, 28, 46 VALENCE, 3, 15, 150 

Vector, 7 
Scacar, 6, 51, 150 Vector function, linear, 61 
Scalar product, 51, 60 Vector manifold, linear, 12 


Simplex method of Dantzig, 103 
Skew (anti-symmetric) matrix, 24 Winpow, 129 
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EL MACHINE 
A IS USING 
MATRICES 

By W. J. Gibbs, D.Sc., M.I.E.E. 


“The book is a carefully planned study of 
matrix applications in machine behaviour 
theory and, for its immediate subject 
matter and as a preamble to the deeper field 
of applied tensor analysis, it merits every 
recommendation. It is a work that can be 
followed quite easily by any reader familiar 
with the equations of machine performance 
expressed in the usual algebraic manner.” 
—ELECTRICAL REVIEW. 


“Dr. Gibbs elucidates a powerful method 
of analysis based on the work of Kron (the 
concept of tearing and the connection 
matrix).”-—ENGINEERING. 


“The book gives a very clear exposition 
of the mathematical method, without 
unnecessary tensor notations (which are 
discussed in the last chapter). As a text 
book, it would form an ideal basis for a 
lecture course which expanded the practical 
implications of the results. A useful list of 
further reading is included.”—Stupents’ 
QUARTERLY JOURNAL. 

17s. 6d. net. 
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THE PERFORMANCE AND DESIGN OF 
ALTERNATING CURRENT MACHINES 
By M. G. SAY 


This well-known work deals comprehensively with the basic theory 
of operation and the applications of the three main categories of a.c, 
machines—transformers, three-phase induction machines and 
synchronous machines. In addition the text is completely revised 
and converted throughout to M.K.S. units. 37s. 6d. net. 


THE PERFORMANCE AND DESIGN OF 
DIRECT CURRENT MACHINES 
By A. E. CLAYTON and N. N. HANCOCK 


Now in its third edition this widely used text book has been com- 
pletely revised. The general treatment is now based on the ration- 
alized m.k.s. system of units. The section on control and special 
machines has been considerably extended. The chapter on insula- 
tion has been rewritten and brought up to date. A book for students 
working for B.Sc.(Eng.) degrees, Grad.I.E.E., Higher National 
Certificate, and similar examinations. 40s. net. 


THE PERFORMANCE AND DESIGN OF 
A.C. COMMUTATOR MOTORS 
By E. OPENSHAW TAYLOR 


This work is intended as a companion to Performance and Design 
of Alternating Current Machines and Performance and Design of 
Direct Current Machines. The first part of the book gives information 
common to all types of commutator motors. The remaining parts 
deal with individual types such as auxiliary machines for the in- 
duction motor; 3-phase commutator motors; and single-phase 
motors, including the single-phase induction motors. 45s. net. 
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